-- Logs begin at Thu 2022-06-02 08:20:30 UTC, end at Thu 2022-06-02 09:35:15 UTC. -- Jun 02 09:02:05.394154 dv-cinder-825492-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 09:02:05.402924 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 09:02:05 2022] *** Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: nodename: dv-cinder-825492-19-iscsi Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: machine: x86_64 Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: clock source: unix Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: pcre jit disabled Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: detected number of CPU cores: 4 Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: current working directory: / Jun 02 09:02:05.404931 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: detected binary path: /usr/bin/uwsgi-core Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: your processes number limit is 47680 Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: your memory page size is 4096 bytes Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: detected max file descriptor number: 2048 Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: lock engine: pthread robust mutexes Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: thunder lock: enabled Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 09:02:05.405637 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 09:02:05.449638 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: Python main interpreter initialized at 0x56243a3069c0 Jun 02 09:02:05.449638 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: python threads support enabled Jun 02 09:02:05.449638 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: your server socket listen backlog is limited to 100 connections Jun 02 09:02:05.449638 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: your mercy for graceful operations on workers is 90 seconds Jun 02 09:02:05.449970 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 09:02:05.450046 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: *** Operational MODE: preforking *** Jun 02 09:02:05.450291 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: *** uWSGI is running in multiple interpreter mode *** Jun 02 09:02:05.450291 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: spawned uWSGI master process (pid: 103622) Jun 02 09:02:05.450476 dv-cinder-825492-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 09:02:05.451026 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: spawned uWSGI worker 1 (pid: 103623, cores: 1) Jun 02 09:02:05.451382 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: spawned uWSGI worker 2 (pid: 103624, cores: 1) Jun 02 09:02:05.451662 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 09:02:06.669118 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 09:02:06.693433 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 09:02:07.394720 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:02:07.394720 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: from cryptography.utils import int_from_bytes Jun 02 09:02:07.395063 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:02:07.395063 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: from cryptography.utils import int_from_bytes Jun 02 09:02:07.405226 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:02:07.405226 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: from cryptography.utils import int_from_bytes Jun 02 09:02:07.405569 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:02:07.405569 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: from cryptography.utils import int_from_bytes Jun 02 09:02:09.983636 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:02:09.984198 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:02:09.984471 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:02:09.984840 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:02:09.984926 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:02:09.985018 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:02:09.985116 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:02:09.985220 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:02:09.985443 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.985588 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:02:09.985770 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.985859 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:02:09.986093 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.986226 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.986410 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.986553 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.986744 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.986879 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987053 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987203 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987397 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987557 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987714 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.987872 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988040 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988195 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988283 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988518 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988614 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988852 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.988939 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-19-iscsi {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989116 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989203 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989434 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989533 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989761 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-19-iscsi {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.989856 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990087 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990184 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990389 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990482 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990702 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.990795 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991004 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991106 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991352 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991529 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991680 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.991981 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992117 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992292 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992486 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992593 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992802 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.992895 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993111 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993219 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993427 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993515 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993766 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.993852 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994086 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994186 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994403 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994504 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994711 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.994813 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995023 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995121 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-19-iscsi {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995377 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995483 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995693 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.995806 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996032 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996136 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-19-iscsi {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996425 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996531 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996743 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.996854 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997072 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997319 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997410 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997490 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997684 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997786 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.997993 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998081 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998319 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998406 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998636 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998733 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.998952 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999041 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999292 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999385 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999595 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999696 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999904 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:09.999993 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000213 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000307 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000530 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000622 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000834 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.000921 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001139 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001225 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001386 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001474 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001694 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.001790 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002013 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002100 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002286 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002373 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002600 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002694 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002869 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.002973 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003116 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003245 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003456 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003563 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003773 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.003870 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004049 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004135 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004371 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004459 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004676 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004772 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.004982 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005069 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005289 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005383 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005596 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005703 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005898 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.005986 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006206 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006304 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006515 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006603 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006824 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.006929 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007146 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007313 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007464 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007549 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007766 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.007854 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008094 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008190 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008397 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008495 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008706 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.008800 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009041 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009146 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009348 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009443 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009651 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.009736 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010225 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010546 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010633 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010854 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.010943 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011158 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011275 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011509 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011595 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011821 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.011915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.012645 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.012742 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.012956 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013042 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013209 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013308 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013510 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013604 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013815 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.013901 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014123 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014217 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014427 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014521 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014734 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.014819 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015034 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015119 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015356 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015453 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015669 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015795 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.015978 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016089 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016281 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016390 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016584 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016686 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016893 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.016998 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017196 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017300 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017503 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017599 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017808 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.017918 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018112 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018208 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018422 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018526 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018734 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.018839 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019039 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019143 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019370 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019478 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019677 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019783 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.019984 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020082 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020291 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020393 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020594 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020698 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.020900 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021009 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021216 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021318 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021522 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021630 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021831 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.021933 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022143 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022240 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022447 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022618 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022753 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.022859 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023068 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023157 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023391 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023482 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023697 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.023783 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024011 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024097 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024312 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024399 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024616 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024701 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.024922 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025010 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025228 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025315 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025531 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025623 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025835 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.025922 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026138 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026224 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026440 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026527 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026745 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.026832 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.027048 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.027142 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.027383 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.027495 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028233 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028351 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028556 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028653 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028865 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.028962 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.029181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.029290 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.029493 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.029589 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.029804 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.029908 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.030124 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:02:10.030229 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.030457 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.030553 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.030788 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.030884 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031115 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031211 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031462 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031559 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031777 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.031884 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032092 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032189 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032419 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032517 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032734 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.032828 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033045 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033140 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033358 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033454 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033677 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033781 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.033995 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034089 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034311 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034406 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034629 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034779 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.034948 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035085 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035284 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035421 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035602 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035736 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.035922 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036057 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036244 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036385 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036588 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036685 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036868 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.036968 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037195 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037281 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037524 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037621 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037838 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.037932 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038162 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038249 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038482 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038582 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038806 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.038944 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039112 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039200 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039451 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039558 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039775 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.039867 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040090 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040178 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040407 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040505 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040726 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.040816 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041039 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041127 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041351 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041443 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041663 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041757 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.041976 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042073 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042285 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042376 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042598 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042691 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.042916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043007 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043319 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043410 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043601 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043697 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.043920 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044235 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044326 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044550 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044643 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044859 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.044968 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045164 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045254 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045470 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045563 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045778 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.045945 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046070 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046158 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046377 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046474 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046688 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.046798 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047004 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047091 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047329 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047421 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047653 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047759 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.047957 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048055 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048270 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048359 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048583 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048679 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048895 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.048981 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049199 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049287 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049509 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049608 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049822 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.049907 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050124 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050209 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050438 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050524 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050747 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.050840 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051052 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051139 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051510 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051706 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.051793 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052012 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052107 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052325 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052412 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052633 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052718 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.052941 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053251 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053340 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053563 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053655 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053876 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.053977 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054192 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054283 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054508 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054596 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054837 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.054935 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055157 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055273 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055499 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055587 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055839 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.055936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056160 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056264 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056467 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056556 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056772 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.056867 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057081 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057168 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057384 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057479 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057688 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057784 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.057988 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058087 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058296 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058383 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058597 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058686 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.058923 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059018 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059227 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059347 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059550 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059637 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059851 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.059945 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060169 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060266 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060479 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060573 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060781 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.060868 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061085 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061183 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061386 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061472 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061724 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.061815 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062026 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062123 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062419 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062677 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062762 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.062985 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063080 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063326 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063417 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063639 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063728 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.063956 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064048 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064266 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064366 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064576 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064668 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064887 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.064983 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065197 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065284 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065515 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065602 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065821 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.065909 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066136 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066223 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066443 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066538 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066760 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.066893 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067065 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067152 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067408 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067526 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067711 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.067844 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068027 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068123 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068348 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068451 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068662 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068807 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.068980 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069067 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069298 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069394 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069606 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069694 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.069921 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070007 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070230 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070330 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070541 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070664 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070849 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.070938 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071157 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071283 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071495 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071582 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071802 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.071888 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072115 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072203 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072422 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072508 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072739 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.072833 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073045 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073138 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073360 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073454 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073662 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073755 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.073974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.074069 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.074294 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.074387 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075113 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075324 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075456 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075546 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075769 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.075856 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076089 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076184 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076399 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076493 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076709 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.076810 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077028 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077134 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077333 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077430 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077635 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077731 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.077945 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078045 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078255 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078341 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078564 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078650 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078877 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.078972 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079180 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079288 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079523 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079616 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079832 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.079923 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080139 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080224 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080440 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080529 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080751 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.080839 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081057 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081151 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081365 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081451 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081678 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081772 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.081993 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082079 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082294 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082382 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082596 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082684 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.082915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083003 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083222 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083370 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083545 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083641 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083849 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.083937 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084152 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084252 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084462 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084547 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084770 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.084859 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085078 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085174 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085393 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085479 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085714 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.085809 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086020 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086118 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086329 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086416 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086638 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086733 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.086956 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087084 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087294 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087389 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087609 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087698 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.087918 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088056 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088227 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088315 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088535 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088626 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088843 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.088968 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089151 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089241 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089460 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089766 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.089861 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.090093 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.090669 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.090942 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091038 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091278 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091368 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091590 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091676 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.091902 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092000 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092211 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092462 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092556 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092793 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.092881 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.093106 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.093382 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.093471 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.093718 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.093805 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094034 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094129 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094357 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094445 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094680 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.094766 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095001 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095089 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095334 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095452 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095646 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095734 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.095953 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096050 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096257 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096362 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096569 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096665 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096875 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097185 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097280 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097488 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097576 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097798 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.097891 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098100 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098194 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098401 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098495 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098701 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.098790 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099005 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099101 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099336 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099426 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099642 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099740 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.099946 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100035 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100247 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100332 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100555 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100641 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100862 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.100987 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101165 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101254 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101467 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101576 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101769 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.101857 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102082 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102167 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102388 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102490 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102696 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.102786 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103029 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103122 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103365 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103469 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103682 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103769 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.103986 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104074 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104305 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104394 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104608 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104695 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104912 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.104999 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105214 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105302 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105523 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105610 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105852 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.105938 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106150 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106237 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106460 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106549 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106768 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.106858 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107074 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107176 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107412 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107545 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107717 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.107835 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108024 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108143 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108325 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108431 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108628 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108735 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.108930 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109034 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109229 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109328 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109528 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109634 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109836 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.109935 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110138 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110234 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110433 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110538 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110739 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.110836 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111042 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111148 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111382 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111473 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111665 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111751 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.111965 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112054 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112264 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112353 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112572 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112658 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112876 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.112970 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113178 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113276 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113489 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113577 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113796 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.113890 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114098 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114187 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114398 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114486 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114705 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.114793 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115004 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115092 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115329 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115422 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115639 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115744 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.115945 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116041 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116255 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116352 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116555 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116655 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116862 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.116950 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117169 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117264 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117470 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117574 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117770 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.117859 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118075 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118161 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118375 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118474 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118672 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118760 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.118970 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119059 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119297 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119412 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119601 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119688 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119906 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.119994 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120215 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120303 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120519 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120606 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120820 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.120907 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.121122 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.121211 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.121956 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122058 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122265 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122362 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122575 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122663 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122908 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.122994 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123214 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123332 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123555 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123651 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123867 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.123955 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124178 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124275 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124490 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124578 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124792 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.124881 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125106 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125411 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125498 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125715 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.125802 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126013 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126108 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126317 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126405 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126634 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126721 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.126938 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127026 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127273 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127363 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127589 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127678 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.127905 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128002 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128216 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128302 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128518 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128616 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128825 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.128916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129132 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129220 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129443 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129543 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129748 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.129837 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130058 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130155 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130366 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130466 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130675 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130762 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.130984 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131072 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131316 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131429 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131626 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131715 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.131930 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132017 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132238 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132335 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132547 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132635 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.132938 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133166 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133268 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133474 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133568 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133778 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.133867 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134088 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134177 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134392 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134486 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134695 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.134781 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.135288 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.135384 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.135604 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.135715 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.135920 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136020 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136228 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136318 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136612 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136720 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.136923 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.137586 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.137774 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.137864 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138091 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138177 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138404 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138518 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138706 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.138800 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139028 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139121 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139373 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139494 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139691 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.139790 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140036 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140122 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140339 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140440 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140642 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140730 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.140950 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141037 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141269 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141365 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141571 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141674 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141874 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.141961 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142176 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142265 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142493 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142585 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142792 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.142879 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143095 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143183 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143441 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143532 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143749 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.143844 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144070 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144164 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144488 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144575 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144806 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.144902 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145113 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145200 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145433 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145536 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145754 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.145852 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146075 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146163 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146379 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146473 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146690 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146790 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.146999 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147100 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147342 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147447 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147669 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147753 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.147978 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148074 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148294 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148381 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148596 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148679 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.148917 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149028 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149232 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149320 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149541 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149635 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149862 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.149971 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150180 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150272 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150496 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150592 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150818 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.150908 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151180 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151321 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151526 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151623 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151831 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.151920 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152133 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152226 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152442 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152529 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152768 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.152858 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153072 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153169 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153393 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153482 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153698 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.153787 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154003 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154311 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154406 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154623 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154709 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.154924 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155011 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155263 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155370 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155575 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155675 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155883 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.155979 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156191 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156288 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156516 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156604 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156823 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.156911 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157146 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157244 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157458 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157553 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157780 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.157869 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158090 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158178 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158398 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158485 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158700 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.158790 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159008 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159098 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159346 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159454 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159661 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159754 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.159969 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160066 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160295 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160389 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160607 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160695 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.160915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161003 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161246 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161334 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161572 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161668 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161883 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.161979 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162197 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162283 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162520 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162617 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162824 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.162913 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163126 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163221 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163459 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163561 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163764 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.163852 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164067 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164156 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164369 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164465 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164674 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164761 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.164972 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165058 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165273 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165362 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165575 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165670 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165878 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.165965 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166183 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166270 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166486 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166572 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166797 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.166883 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167099 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167204 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167426 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167521 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167736 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.167824 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168046 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168143 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168379 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168468 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168690 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.168827 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169008 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169096 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169325 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169412 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169652 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169749 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.169963 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170052 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170283 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170371 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170596 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170694 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.170911 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171000 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171226 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171337 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171560 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171660 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171875 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.171972 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172188 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172276 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172503 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172591 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172812 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.172898 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173128 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173216 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173441 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173529 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173753 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.173840 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174071 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174268 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174391 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174601 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174716 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.174923 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175274 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175376 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175584 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175717 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175901 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.175990 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176216 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176380 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176530 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176619 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176843 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.176940 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177153 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177250 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177463 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177552 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177777 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.177864 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178095 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178192 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178412 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178501 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178744 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.178831 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179060 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179156 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179396 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179501 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179712 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.179800 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180022 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180107 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180357 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180453 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180677 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180772 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.180983 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181078 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181296 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181391 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181608 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181705 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.181922 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182018 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182230 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182318 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182538 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182634 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182850 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.182939 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.183160 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.183268 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.183495 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.183588 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.184317 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.184414 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.184640 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.184728 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.184951 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185262 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185348 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185580 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185668 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185897 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.185986 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186206 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186293 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186517 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186615 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186830 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.186926 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.187170 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.187373 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.187513 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.187697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.187833 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188037 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188360 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188456 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188682 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188779 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.188997 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189082 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189314 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189411 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189639 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189735 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.189944 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190250 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190338 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190562 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190651 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190873 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.190962 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191176 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191283 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191521 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191618 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191833 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.191917 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192138 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192225 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192456 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192544 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192768 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.192855 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193074 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193293 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193404 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193632 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193719 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.193951 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194239 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194336 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194583 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194671 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194897 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.194983 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195204 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195342 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195551 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195652 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195856 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.195944 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196162 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196260 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196476 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196564 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196784 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.196872 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197088 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197177 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197399 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197486 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197705 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.197791 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198010 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198312 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198414 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198623 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198712 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.198927 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.199016 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.199257 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.199348 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200139 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200248 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200452 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200549 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200757 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.200853 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201072 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201173 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201379 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201468 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201681 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201767 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.201987 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202088 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202292 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202380 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202597 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202684 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202899 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.202994 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203204 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203356 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203530 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203617 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203837 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.203932 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204139 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204226 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204447 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204535 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204762 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.204850 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205069 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205157 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205385 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205472 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205686 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.205774 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206000 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206088 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206313 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206407 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206634 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206737 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.206947 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207034 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207312 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207405 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207613 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207710 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.207928 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208016 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208245 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208461 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208593 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208796 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.208918 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.209115 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.209447 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.209546 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.209778 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.209867 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210088 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210176 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210394 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210490 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210699 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.210787 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211022 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211118 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211364 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211469 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211664 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211751 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.211974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212062 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212287 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212391 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212595 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212683 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212904 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.212988 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213213 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213302 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213520 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213608 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213829 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.213917 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214138 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214228 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214447 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214754 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.214852 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215075 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215166 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215418 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215508 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215735 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.215836 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216050 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216139 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216364 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216680 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216779 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.216994 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217083 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217302 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217390 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217610 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217698 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.217915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218002 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218226 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218314 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218539 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218642 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.218939 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219159 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219274 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219486 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219590 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219818 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.219915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220144 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220242 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220453 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220584 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220805 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.220892 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221114 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221212 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221433 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221531 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221749 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.221838 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222056 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222154 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222378 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222475 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222688 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.222777 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223013 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223142 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223361 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223452 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223682 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.223772 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224000 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224096 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224303 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224392 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224606 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224702 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.224907 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225003 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225215 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225303 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225528 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225623 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225835 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.225925 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226135 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226224 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226435 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226538 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226744 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.226831 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227045 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227134 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227369 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227473 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227670 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227758 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.227974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228070 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228284 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228381 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228581 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228677 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228882 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.228970 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229181 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229278 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229480 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229569 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229779 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.229866 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230079 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230168 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230382 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230469 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230678 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.230792 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231003 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231092 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231334 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231424 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231637 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231727 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.231937 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232025 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232243 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232381 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232550 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232639 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232856 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.232946 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233186 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233280 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233495 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233602 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233813 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.233910 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234121 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234209 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234437 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234534 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234750 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.234838 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235062 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235158 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235395 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235498 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235724 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.235820 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236031 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236119 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236342 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236439 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236656 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236775 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.236968 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237079 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237274 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237374 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237583 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237694 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237894 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.237992 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238209 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238307 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238508 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238604 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238828 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.238924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239144 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239275 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239475 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239585 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239791 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.239900 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240099 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240190 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240419 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240506 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240729 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.240842 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241039 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241138 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241352 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241443 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241661 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241763 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.241970 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242070 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242284 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242373 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242595 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242685 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.242913 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243001 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243245 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243372 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243564 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243662 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243887 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.243985 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244208 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244304 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244520 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244608 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244846 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.244933 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245171 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245304 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245494 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245577 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245804 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.245892 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.246115 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.246212 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.246937 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.247042 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.247176 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:02:10.247386 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.247705 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.248015 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:02:10.248259 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:02:10.304745 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Registered counter for database nova_api Jun 02 09:02:10.306240 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Registered counter for database nova_api Jun 02 09:02:10.326261 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.327786 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.333762 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.335060 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.389903 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.context [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2313d202-a844-40de-8f2e-fd9d46062c17(cell1) {{(pid=103624) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 09:02:10.390773 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.context [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2313d202-a844-40de-8f2e-fd9d46062c17(cell1) {{(pid=103623) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 09:02:10.394101 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:02:10.394936 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:02:10.395703 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:02:10.396502 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:02:10.396609 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:02:10.397341 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:02:10.398465 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_concurrency.lockutils [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:02:10.399316 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:02:10.400493 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Registered counter for database nova_cell0 Jun 02 09:02:10.401311 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Registered counter for database nova_cell0 Jun 02 09:02:10.404748 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Registered counter for database nova_cell1 Jun 02 09:02:10.405280 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Registered counter for database nova_cell1 Jun 02 09:02:10.411834 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.414227 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.417003 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.417236 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.421267 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.421561 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.424289 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.563784 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.571713 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO dbcounter [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Registered counter for database nova_cell0 Jun 02 09:02:10.573584 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO dbcounter [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Registered counter for database nova_cell0 Jun 02 09:02:10.580369 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_db.sqlalchemy.engines [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.583904 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG oslo_db.sqlalchemy.engines [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:02:10.584777 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writer thread running {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:10.588358 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writer thread running {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:02:11.101909 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:02:11.109881 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:02:11.124268 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:02:11.131561 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:02:11.332555 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:02:11.338377 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: WARNING keystonemiddleware.auth_token [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:02:11.344051 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243a3069c0 pid: 103623 (default app) Jun 02 09:02:11.346377 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:02:11.347567 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001951 Jun 02 09:02:11.347972 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Thu Jun 2 09:02:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:02:11.356149 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:02:11.362101 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: WARNING keystonemiddleware.auth_token [None req-d6c0b088-0780-4fee-a484-188b8280ac96 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:02:11.367208 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243a3069c0 pid: 103624 (default app) Jun 02 09:03:32.126299 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:32.127370 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 02 09:03:32.127785 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:32.140516 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:32.141627 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell1:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:32.142476 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell0:SELECT=3 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:32.143503 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:32.587944 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-5591b69b-9e7e-4ae7-910f-d3fdc6532dd8 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:32.617945 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-5591b69b-9e7e-4ae7-910f-d3fdc6532dd8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482952 Jun 02 09:03:32.618686 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 2 09:03:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:03:34.905136 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:34.906185 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-5f3a4186-5627-4c31-a3ec-4bfe82dc4eee None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 02 09:03:34.906517 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:34.973003 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-1ce965c6-d674-4edc-b9a4-9b3bf21a4546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:34.999393 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:03:34.999393 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: warnings.warn(msg) Jun 02 09:03:35.092313 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-1ce965c6-d674-4edc-b9a4-9b3bf21a4546 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.179351 Jun 02 09:03:35.093185 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:35.106250 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:35.107261 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:35.108313 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell1:SELECT=3 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:35.109081 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:03:35.327913 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-6742024a-cff1-42e4-8708-7d9e7c66a71e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:35.330335 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:03:35.330335 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:03:35.494939 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-6742024a-cff1-42e4-8708-7d9e7c66a71e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.393191 Jun 02 09:03:35.495937 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 2 09:03:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:03:37.831894 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-1ce965c6-d674-4edc-b9a4-9b3bf21a4546 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:37.832929 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-1ce965c6-d674-4edc-b9a4-9b3bf21a4546 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jun 02 09:03:37.833332 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:37.960645 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1c1d4e4f-7b42-4504-aa08-d81c97b7069c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:37.978273 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:03:37.978273 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:03:38.048403 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1c1d4e4f-7b42-4504-aa08-d81c97b7069c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.207946 Jun 02 09:03:38.048880 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:38.061526 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-bdffb1d2-2e89-40af-a9f1-da0b808e0861 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:38.063184 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:03:38.063184 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: warnings.warn(msg) Jun 02 09:03:38.164965 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-bdffb1d2-2e89-40af-a9f1-da0b808e0861 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107014 Jun 02 09:03:38.168266 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 2 09:03:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:03:40.567367 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1c1d4e4f-7b42-4504-aa08-d81c97b7069c admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:40.569012 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1c1d4e4f-7b42-4504-aa08-d81c97b7069c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Jun 02 09:03:40.569599 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:40.632716 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-18db82b9-ba22-469a-836c-94f1fede8a4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "disk": 10}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:40.730915 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-18db82b9-ba22-469a-836c-94f1fede8a4f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154699 Jun 02 09:03:40.731859 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:40.744248 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-84179304-b653-497e-941b-7b1495f23afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:40.831589 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-84179304-b653-497e-941b-7b1495f23afa admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091087 Jun 02 09:03:40.832202 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 2 09:03:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:03:43.136992 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-18db82b9-ba22-469a-836c-94f1fede8a4f admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:43.138180 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-18db82b9-ba22-469a-836c-94f1fede8a4f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Jun 02 09:03:43.138751 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:43.199105 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-385983d7-6c2b-499c-b66a-d4d8784ac85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:43.267598 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-385983d7-6c2b-499c-b66a-d4d8784ac85b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.122666 Jun 02 09:03:43.268155 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:43.280548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-a0d094e0-26bc-4028-98d7-ba62f629d066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:43.363087 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-a0d094e0-26bc-4028-98d7-ba62f629d066 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086299 Jun 02 09:03:43.363802 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 2 09:03:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:03:45.662330 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-385983d7-6c2b-499c-b66a-d4d8784ac85b admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:45.663374 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-385983d7-6c2b-499c-b66a-d4d8784ac85b admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 02 09:03:45.664059 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:45.721220 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "swap": 0, "disk": 20, "name": "ds4G"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:45.806673 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136566 Jun 02 09:03:45.807247 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 09:03:45.819535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-0b947435-af0c-48f2-9596-5858ba168852 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:45.897658 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-0b947435-af0c-48f2-9596-5858ba168852 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082074 Jun 02 09:03:45.898350 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Thu Jun 2 09:03:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:03:48.209470 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:48.210506 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 02 09:03:48.210914 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:48.271456 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-bd4421b7-6fc2-4052-b7c1-1ab2c80cfe9c admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:48.296541 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-bd4421b7-6fc2-4052-b7c1-1ab2c80cfe9c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079452 Jun 02 09:03:48.297082 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 2 09:03:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:03:51.398674 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:51.399741 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-26211f7f-df9f-46b1-8787-35d2af9ae071 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 02 09:03:51.400165 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:51.474069 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-8a8c9a7f-3821-4506-88c2-9a4415794186 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "disk": 1}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:51.567635 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-8a8c9a7f-3821-4506-88c2-9a4415794186 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.160942 Jun 02 09:03:51.568211 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:51.582600 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-f812458f-c814-4a8f-983d-44fec0e048e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:51.672510 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-f812458f-c814-4a8f-983d-44fec0e048e7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093638 Jun 02 09:03:51.673202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 2 09:03:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:03:54.552221 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-8a8c9a7f-3821-4506-88c2-9a4415794186 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:54.553271 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-8a8c9a7f-3821-4506-88c2-9a4415794186 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jun 02 09:03:54.553692 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:54.616003 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-253a850f-63a3-4d34-b527-8faf2947284a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:54.707707 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-253a850f-63a3-4d34-b527-8faf2947284a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147721 Jun 02 09:03:54.708219 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:54.720844 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-fdd53ccc-ff88-4d9a-85f7-d78efe05ffd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:54.797801 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-fdd53ccc-ff88-4d9a-85f7-d78efe05ffd3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080568 Jun 02 09:03:54.798334 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 2 09:03:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:03:57.173636 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-253a850f-63a3-4d34-b527-8faf2947284a admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:57.174752 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-253a850f-63a3-4d34-b527-8faf2947284a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jun 02 09:03:57.175242 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:57.233204 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-9dc2bff1-f73a-454e-b065-789a694f6f44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:57.298752 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-9dc2bff1-f73a-454e-b065-789a694f6f44 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.117768 Jun 02 09:03:57.299420 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:03:57.311074 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-61ff4d07-a77f-4d44-8cea-ba66c8bc72c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:57.388851 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-61ff4d07-a77f-4d44-8cea-ba66c8bc72c4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081375 Jun 02 09:03:57.389438 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 2 09:03:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:03:59.688827 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-9dc2bff1-f73a-454e-b065-789a694f6f44 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:03:59.690458 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-9dc2bff1-f73a-454e-b065-789a694f6f44 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Jun 02 09:03:59.690865 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:03:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:03:59.755794 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-57ec83f8-ba75-4a0b-9846-17b59f6f6488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "swap": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:59.839296 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-57ec83f8-ba75-4a0b-9846-17b59f6f6488 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142178 Jun 02 09:03:59.840341 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:03:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 09:03:59.852438 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-d1b86dd3-af40-4d94-9b57-e49597e3909d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:03:59.959634 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-d1b86dd3-af40-4d94-9b57-e49597e3909d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111221 Jun 02 09:03:59.960773 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 2 09:03:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:04:02.375857 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-57ec83f8-ba75-4a0b-9846-17b59f6f6488 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:02.377575 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-57ec83f8-ba75-4a0b-9846-17b59f6f6488 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002239 Jun 02 09:04:02.378440 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:02.440146 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:02.518883 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.134626 Jun 02 09:04:02.519784 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Thu Jun 2 09:04:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:04:02.531430 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-cce7b985-c808-4b4f-a0fd-63469bb5e1b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:02.535271 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:02.608498 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-cce7b985-c808-4b4f-a0fd-63469bb5e1b8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080873 Jun 02 09:04:02.623003 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Thu Jun 2 09:04:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:04:25.933679 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:25.934690 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 02 09:04:25.935093 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:25.998399 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-8e32aa51-0b4c-4870-a6ed-a7364109198d admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:26.016038 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-8e32aa51-0b4c-4870-a6ed-a7364109198d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074931 Jun 02 09:04:26.016580 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 2 09:04:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:27.007770 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:27.009301 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-f448ad7a-8f53-430f-ad09-bebd9e57bd1d admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Jun 02 09:04:27.009695 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:27.207175 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-18b0aa0f-aef9-4eaa-9dd2-43cd48d0398a admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:27.213270 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-18b0aa0f-aef9-4eaa-9dd2-43cd48d0398a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-18b0aa0f-aef9-4eaa-9dd2-43cd48d0398a admin admin] Request method failure captured: Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept: application/json Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Connection: keep-alive Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Content-Length: 0 Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Host: 10.222.0.18 Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABimH0aWoqRCWKsuqAjyaYgfCtvWxTS4EV0dJvxcTnoTAAiChmqUQytOxssFlUyc-oNI44QyMxrerU8jbXaSsp923ttEyqiuHIbfpolkHtL7-J_RbCZ7Y_UKCVzwkRrD3hJy58dAD9XvsvhgABkuagxUlbUqsYGZWAyRcnvSsHwN3mL-5U Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Role: admin,member,reader Jun 02 09:04:27.216558 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Roles: admin,member,reader Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant: admin Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User: admin Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Name: admin Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: method: > Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: exception: Flavor 42 could not be found. Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: action_args: {'id': '42'} Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:27.218202 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:27.219097 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.220565 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-18b0aa0f-aef9-4eaa-9dd2-43cd48d0398a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:27.221984 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-18b0aa0f-aef9-4eaa-9dd2-43cd48d0398a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061564 Jun 02 09:04:27.221984 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 2 09:04:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:27.227587 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-6cb4b6bf-8de8-41f6-89d0-874696db1085 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:27.230523 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:04:27.248617 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-6cb4b6bf-8de8-41f6-89d0-874696db1085 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024559 Jun 02 09:04:27.249145 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:27.260569 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-8893434b-6d91-4b64-8fde-df22d23faea1 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:27.282180 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-8893434b-6d91-4b64-8fde-df22d23faea1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025655 Jun 02 09:04:27.282728 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:27.292123 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f563f162-018d-4436-9a3c-8182b09d8cf1 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:27.297711 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-f563f162-018d-4436-9a3c-8182b09d8cf1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f563f162-018d-4436-9a3c-8182b09d8cf1 admin admin] Request method failure captured: Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept: application/json Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Connection: keep-alive Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Content-Length: 0 Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Host: 10.222.0.18 Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABimH0aWoqRCWKsuqAjyaYgfCtvWxTS4EV0dJvxcTnoTAAiChmqUQytOxssFlUyc-oNI44QyMxrerU8jbXaSsp923ttEyqiuHIbfpolkHtL7-J_RbCZ7Y_UKCVzwkRrD3hJy58dAD9XvsvhgABkuagxUlbUqsYGZWAyRcnvSsHwN3mL-5U Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Role: admin,member,reader Jun 02 09:04:27.301019 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Roles: admin,member,reader Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant: admin Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User: admin Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Name: admin Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: method: > Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: exception: Flavor 42 could not be found. Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: action_args: {'id': '42'} Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:27.305924 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:27.306851 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:27.308181 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-f563f162-018d-4436-9a3c-8182b09d8cf1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:27.309388 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-f563f162-018d-4436-9a3c-8182b09d8cf1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014139 Jun 02 09:04:27.309388 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 2 09:04:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:28.165968 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-8893434b-6d91-4b64-8fde-df22d23faea1 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:28.166989 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-8893434b-6d91-4b64-8fde-df22d23faea1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 02 09:04:28.167427 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:28.353589 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-869be9e9-f281-4e70-b941-ca4c2db0951b admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:28.358805 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-869be9e9-f281-4e70-b941-ca4c2db0951b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-869be9e9-f281-4e70-b941-ca4c2db0951b admin admin] Request method failure captured: Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept: application/json Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Connection: keep-alive Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Content-Length: 0 Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Host: 10.222.0.18 Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABimH0cXO0qCoydhU9cAVNfqj3_xMzMKJaMzRb_9dfbZTRA13F9WdHxM9RmP-o_ZELy7HmWWGxq2fsvCTaksmE3x-8QWTVw_3msus7iPrd5mRdFUxTtb3kuirEVFfFWr-k0_oT-GmaIOvLhbj5ivWcL6nwlD2aROaZW3XP84fSBPck9mQk Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Role: admin,member,reader Jun 02 09:04:28.360333 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Roles: admin,member,reader Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant: admin Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User: admin Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Name: admin Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: method: > Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: exception: Flavor 84 could not be found. Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: action_args: {'id': '84'} Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:28.361916 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:28.362982 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.364535 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-869be9e9-f281-4e70-b941-ca4c2db0951b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:28.365818 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-869be9e9-f281-4e70-b941-ca4c2db0951b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060355 Jun 02 09:04:28.365818 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 2 09:04:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:28.371904 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-827f34ba-1aab-4798-b70c-50b43a8d34d9 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:28.386659 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-827f34ba-1aab-4798-b70c-50b43a8d34d9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017960 Jun 02 09:04:28.387120 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:28.396459 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-6746a783-9596-4eaf-bf0e-3e1b5ec6e139 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:28.410076 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-6746a783-9596-4eaf-bf0e-3e1b5ec6e139 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017452 Jun 02 09:04:28.410592 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:28.419401 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-75313ffc-bafd-4538-927f-6e5642739fdd admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:28.424609 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-75313ffc-bafd-4538-927f-6e5642739fdd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-75313ffc-bafd-4538-927f-6e5642739fdd admin admin] Request method failure captured: Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept: application/json Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Connection: keep-alive Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Content-Length: 0 Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Host: 10.222.0.18 Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABimH0cXO0qCoydhU9cAVNfqj3_xMzMKJaMzRb_9dfbZTRA13F9WdHxM9RmP-o_ZELy7HmWWGxq2fsvCTaksmE3x-8QWTVw_3msus7iPrd5mRdFUxTtb3kuirEVFfFWr-k0_oT-GmaIOvLhbj5ivWcL6nwlD2aROaZW3XP84fSBPck9mQk Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Role: admin,member,reader Jun 02 09:04:28.426105 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Roles: admin,member,reader Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant: admin Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User: admin Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Name: admin Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: method: > Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: exception: Flavor 84 could not be found. Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: action_args: {'id': '84'} Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:28.427743 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:28.428697 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:28.430548 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-75313ffc-bafd-4538-927f-6e5642739fdd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:28.431802 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-75313ffc-bafd-4538-927f-6e5642739fdd admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011443 Jun 02 09:04:28.431802 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Thu Jun 2 09:04:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:29.285438 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-6746a783-9596-4eaf-bf0e-3e1b5ec6e139 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:29.286447 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-6746a783-9596-4eaf-bf0e-3e1b5ec6e139 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 02 09:04:29.286841 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:29.472187 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-53349e51-b12e-4ec5-862f-7eadbe1e64f6 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:29.477890 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.wsgi [None req-53349e51-b12e-4ec5-862f-7eadbe1e64f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-53349e51-b12e-4ec5-862f-7eadbe1e64f6 admin admin] Request method failure captured: Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept: application/json Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Accept-Encoding: gzip, deflate Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Connection: keep-alive Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Content-Length: 0 Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Host: 10.222.0.18 Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Openstack-System-Scope: None Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: User-Agent: python-novaclient Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Auth-Token: gAAAAABimH0dYD8Yd1kfugleKzIElHWEJtTwUts8TuwRjRIyJh8eXbY_VbE9qglSHKCgIXy8iUWSIKF9nebbTswqmfLpVCZjeuhF6BlrTOttXHLAlRM-o0-_gJ5oOv6ZvQIEo-z_NzIGqfzfGJjp_cpz6pbbnJNjcfi1Ponc1W6KvrBZZRxi9PU Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Id: None Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Domain-Name: None Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Identity-Status: Confirmed Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Is-Admin-Project: True Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Id: default Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Domain-Name: Default Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Project-Name: admin Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Role: admin,member,reader Jun 02 09:04:29.479400 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Roles: admin,member,reader Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant: admin Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-Tenant-Name: admin Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User: admin Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Id: default Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Domain-Name: Default Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: X-User-Name: admin Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: method: > Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: exception: Flavor 451 could not be found. Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: action_args: {'id': '451'} Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:29.480974 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:29.481936 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.483383 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-53349e51-b12e-4ec5-862f-7eadbe1e64f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:29.484622 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-53349e51-b12e-4ec5-862f-7eadbe1e64f6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059381 Jun 02 09:04:29.484622 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:04:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:29.490426 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-138cb2d0-81f5-480b-9ed4-e9db35a187bb admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:29.503921 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-138cb2d0-81f5-480b-9ed4-e9db35a187bb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017000 Jun 02 09:04:29.504394 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:29.514014 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:29.527879 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017482 Jun 02 09:04:29.528406 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Thu Jun 2 09:04:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:04:29.537660 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-9b0dbf22-4a7e-476f-9aac-458382db4839 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:29.542931 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.wsgi [None req-9b0dbf22-4a7e-476f-9aac-458382db4839 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-9b0dbf22-4a7e-476f-9aac-458382db4839 admin admin] Request method failure captured: Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept: application/json Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Accept-Encoding: gzip, deflate Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Connection: keep-alive Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Content-Length: 0 Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Host: 10.222.0.18 Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-Api-Version: compute 2.90 Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Openstack-System-Scope: None Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: User-Agent: python-novaclient Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Auth-Token: gAAAAABimH0dYD8Yd1kfugleKzIElHWEJtTwUts8TuwRjRIyJh8eXbY_VbE9qglSHKCgIXy8iUWSIKF9nebbTswqmfLpVCZjeuhF6BlrTOttXHLAlRM-o0-_gJ5oOv6ZvQIEo-z_NzIGqfzfGJjp_cpz6pbbnJNjcfi1Ponc1W6KvrBZZRxi9PU Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Id: None Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Domain-Name: None Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Identity-Status: Confirmed Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Is-Admin-Project: True Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Id: default Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Domain-Name: Default Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Project-Name: admin Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Role: admin,member,reader Jun 02 09:04:29.544450 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Roles: admin,member,reader Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4962d1508e764b5186cbd90b7013448e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4962d1508e764b5186cbd90b7013448e", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant: admin Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Id: 4962d1508e764b5186cbd90b7013448e Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-Tenant-Name: admin Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User: admin Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Id: default Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Domain-Name: Default Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Id: 7467262b6fdb458fb130b708a0227640 Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: X-User-Name: admin Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: method: > Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: exception: Flavor 451 could not be found. Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: action_args: {'id': '451'} Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:04:29.546040 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:29.546958 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: ERROR nova.api.openstack.wsgi Jun 02 09:04:29.548035 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-9b0dbf22-4a7e-476f-9aac-458382db4839 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103623) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:04:29.549032 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-9b0dbf22-4a7e-476f-9aac-458382db4839 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011705 Jun 02 09:04:29.549032 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:04:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 09:04:30.405871 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:30.406868 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 02 09:04:30.407298 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:30.594498 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-0b0ef320-7660-41ad-8d15-acc14d1884c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:30.669239 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-0b0ef320-7660-41ad-8d15-acc14d1884c0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.124967 Jun 02 09:04:30.669784 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 2 09:04:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:04:31.531073 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:31.532113 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 02 09:04:31.532510 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:31.721067 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-29032f76-9354-43b4-b923-933edd6a5392 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:31.828702 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-29032f76-9354-43b4-b923-933edd6a5392 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.158466 Jun 02 09:04:31.829174 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 2 09:04:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:04:32.695954 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:32.697019 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 02 09:04:32.697423 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:32.884564 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-2a531bd9-3d66-4fa5-b6da-3f1c9f02f0bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:32.995656 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-2a531bd9-3d66-4fa5-b6da-3f1c9f02f0bf admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.162903 Jun 02 09:04:32.996204 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 2 09:04:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:04:33.872998 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:33.873997 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 02 09:04:33.874394 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:34.063919 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-80fc3317-c107-42dd-8cc4-448d198b8ff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:04:34.178405 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-80fc3317-c107-42dd-8cc4-448d198b8ff0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.164720 Jun 02 09:04:34.178941 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Thu Jun 2 09:04:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:04:35.037506 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:35.038508 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 02 09:04:35.038902 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:04:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:04:35.224939 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-04d03d86-9dad-4f94-80ea-564488cec6ab admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:04:35.244319 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-04d03d86-9dad-4f94-80ea-564488cec6ab admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069010 Jun 02 09:04:35.244842 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Thu Jun 2 09:04:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:05:36.165879 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.166824 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fa023f7d-716c-46b7-9616-f00ef699fcde admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 02 09:05:36.167223 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:05:36.174275 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:05:36.226369 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-476678c9-af95-400c-9c74-4905bdb3db9b admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.245985 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-476678c9-af95-400c-9c74-4905bdb3db9b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073083 Jun 02 09:05:36.246512 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:05:36.267228 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG dbcounter [-] [103624] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:05:36.270885 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-fd86ee80-7a74-44a0-a9cc-bc506c4255c9 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.278391 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-fd86ee80-7a74-44a0-a9cc-bc506c4255c9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012570 Jun 02 09:05:36.278899 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:05:36.290921 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-a98e9f1e-9ee6-47c9-a4b6-883c3fdf9aba admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.298658 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-a98e9f1e-9ee6-47c9-a4b6-883c3fdf9aba admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012053 Jun 02 09:05:36.299172 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:05:36.310432 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.318156 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011031 Jun 02 09:05:36.318698 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:05:36.329645 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-ddb712fc-a129-4308-94a3-fc732c1e9fb2 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:05:36.337131 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-ddb712fc-a129-4308-94a3-fc732c1e9fb2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011091 Jun 02 09:05:36.337684 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Thu Jun 2 09:05:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:08:57.228555 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:08:57.229583 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 02 09:08:57.229980 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:08:57.384954 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=6 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:08:57.503059 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:08:57.504271 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:08:57.504271 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:08:57.506157 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:08:57.506598 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:08:57.507413 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:08:57.507871 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:08:57.540765 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-1977d73a-8da9-4e5e-a445-13f44c6785eb admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.157239 Jun 02 09:08:57.541313 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:08:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:08:58.409572 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:08:58.410664 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 02 09:08:58.411064 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:08:58.599150 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:08:58.600470 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:08:58.600470 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:08:58.601663 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:08:58.602101 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:08:58.602887 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:08:58.603464 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:08:58.624713 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-09adf934-0848-4e58-9d6a-dec9813aeac1 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076135 Jun 02 09:08:58.625268 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:08:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:09:09.908717 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:09:09.909721 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 02 09:09:09.910140 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:09:10.049892 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell0:SELECT=4 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:10.050603 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_cell1:SELECT=4 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:10.051752 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG dbcounter [-] [103623] Writing DB stats nova_api:SELECT=8 {{(pid=103623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:09:10.099167 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:09:10.100463 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:09:10.100463 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:09:10.101650 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:09:10.102092 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:09:10.102878 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:09:10.103343 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:09:10.129562 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-29735b7a-5e87-47d1-b547-db5c64da932e admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083362 Jun 02 09:09:10.130104 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:09:10 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:09:10.993114 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: DEBUG nova.api.openstack.wsgi [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] Calling method '>' {{(pid=103624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:09:10.994140 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: INFO nova.api.openstack.requestlog [None req-48d335ea-3e1c-416a-861c-1db36ac48b24 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 02 09:09:10.994570 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: [pid: 103624|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Thu Jun 2 09:09:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:09:11.184145 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG nova.api.openstack.wsgi [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] Calling method '>' {{(pid=103623) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:09:11.185312 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 09:09:11.185312 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: warnings.warn(msg) Jun 02 09:09:11.186491 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:09:11.186935 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:09:11.187761 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:09:11.188192 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: DEBUG oslo_concurrency.lockutils [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103623) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:09:11.209385 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: INFO nova.api.openstack.requestlog [None req-6058ef3e-2273-47c3-ad27-ac3780d19bda admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.075966 Jun 02 09:09:11.209935 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: [pid: 103623|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Thu Jun 2 09:09:11 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:10:09.065193 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: Thu Jun 2 09:10:09 2022 - graceful shutdown triggered... Jun 02 09:10:09.064641 dv-cinder-825492-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 09:10:09.066213 dv-cinder-825492-19-iscsi devstack@n-api.service[103623]: Gracefully killing worker 1 (pid: 103623)... Jun 02 09:10:09.066577 dv-cinder-825492-19-iscsi devstack@n-api.service[103624]: Gracefully killing worker 2 (pid: 103624)... Jun 02 09:10:10.065640 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: worker 1 buried after 1 seconds Jun 02 09:10:10.066071 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: worker 2 buried after 1 seconds Jun 02 09:10:10.066071 dv-cinder-825492-19-iscsi devstack@n-api.service[103622]: goodbye to uWSGI. Jun 02 09:10:10.067218 dv-cinder-825492-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 09:10:10.067807 dv-cinder-825492-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 09:10:10.071024 dv-cinder-825492-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 09:10:10.084659 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 09:10:10 2022] *** Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: nodename: dv-cinder-825492-19-iscsi Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: machine: x86_64 Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: clock source: unix Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: pcre jit disabled Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: detected number of CPU cores: 4 Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: current working directory: / Jun 02 09:10:10.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: detected binary path: /usr/bin/uwsgi-core Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: your processes number limit is 47680 Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: your memory page size is 4096 bytes Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: detected max file descriptor number: 2048 Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: lock engine: pthread robust mutexes Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: thunder lock: enabled Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 09:10:10.096150 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 09:10:10.144704 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: Python main interpreter initialized at 0x559898cb99c0 Jun 02 09:10:10.144704 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: python threads support enabled Jun 02 09:10:10.144704 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: your server socket listen backlog is limited to 100 connections Jun 02 09:10:10.144704 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: your mercy for graceful operations on workers is 90 seconds Jun 02 09:10:10.145153 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 09:10:10.145153 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: *** Operational MODE: preforking *** Jun 02 09:10:10.145445 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: *** uWSGI is running in multiple interpreter mode *** Jun 02 09:10:10.145445 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: spawned uWSGI master process (pid: 118017) Jun 02 09:10:10.145651 dv-cinder-825492-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 09:10:10.147933 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: spawned uWSGI worker 1 (pid: 118037, cores: 1) Jun 02 09:10:10.147933 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: spawned uWSGI worker 2 (pid: 118038, cores: 1) Jun 02 09:10:10.147933 dv-cinder-825492-19-iscsi devstack@n-api.service[118017]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 09:10:11.379008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 09:10:11.386265 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 09:10:12.209831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:10:12.209831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: from cryptography.utils import int_from_bytes Jun 02 09:10:12.210229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:10:12.210229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: from cryptography.utils import int_from_bytes Jun 02 09:10:12.212651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:10:12.212651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: from cryptography.utils import int_from_bytes Jun 02 09:10:12.212993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:10:12.212993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: from cryptography.utils import int_from_bytes Jun 02 09:10:14.581146 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:10:14.581721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:10:14.581930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:10:14.582296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:10:14.582556 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:10:14.582949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.583446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.583700 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.584027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.584364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.584686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.585012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.585867 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.586202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.586467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.586789 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.587120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-19-iscsi {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.587486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.587802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.588119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.588443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.588756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.589083 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.589394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.589906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.590357 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.590672 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.590991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.591357 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.591685 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.592000 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.592328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.592645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.592973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.593289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.593690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-19-iscsi {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.594012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.594181 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:10:14.594599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.594687 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:10:14.594780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.594970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:10:14.595107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.595341 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:10:14.595450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.595599 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:10:14.595726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.595984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.596952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597285 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597597 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.597917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598244 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.598888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-19-iscsi {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599766 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.599864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.600789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.601547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.601719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.601878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602362 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602461 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.602876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603015 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603353 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603669 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.603980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604331 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.604922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.605880 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606072 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606246 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-19-iscsi {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.606825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607051 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.607830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608045 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.608810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609341 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609754 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.609967 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610279 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610894 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.610983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611204 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.611904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612522 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.612789 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613412 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.613945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614196 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614343 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.614849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615416 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.615833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616031 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616132 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.616979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617074 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617288 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617723 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.617996 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618609 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.618926 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.619887 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620505 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.620822 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621041 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621351 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621830 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.621976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622066 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622896 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.622992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623204 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623638 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623793 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.623899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624192 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.624827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625115 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625744 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.625942 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626250 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626559 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626676 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.626964 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.627177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.627298 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.627511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.627624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.627816 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.627924 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.628126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.628229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.628432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.628537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.628738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.628841 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.629058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.629171 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.629382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.629496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.629691 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.629815 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.629998 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.630135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.630305 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.630466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.630613 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.630781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.630935 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.631096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.631282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.631435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.631568 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.631765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.631895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.632115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.632215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.632452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.632552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.632774 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.632865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.633098 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.633188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.633413 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.633517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.633725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.633823 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.634027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.634117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.634335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.634440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.634654 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.634795 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.634962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.635056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.635285 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.635397 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.635589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.635687 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.635895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.635992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.636198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.636318 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.636502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.636935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.637032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.637123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.637217 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.637566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.637712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.637807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.637947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.638124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.638269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.638457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.638562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.638774 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.638864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.639095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.639194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.639435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.639538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:10:14.639751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.639849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640067 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640381 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.640854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641037 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641189 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641356 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.641997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642170 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642317 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.642946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643584 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.643878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.644876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.645834 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.646956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.647065 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.647286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.647393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648304 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.648905 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649060 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649342 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649790 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.649966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650436 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.650912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651221 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651345 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.651973 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652198 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.652935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.653867 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654090 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654192 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.654819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655396 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.655995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656111 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.656979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657262 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.657869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658083 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658702 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.658850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659628 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.659932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660031 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660548 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.660953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661181 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661280 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661496 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661600 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.661892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662527 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.662822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.663045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.663143 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.663920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664032 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664268 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664586 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.664913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665272 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665538 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665637 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.665945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666807 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.666899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667596 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.667897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.668810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669735 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.669934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670035 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670236 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.670944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.671907 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672221 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.672820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673057 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.673783 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674343 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674442 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.674970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.675925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676068 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676213 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676498 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.676990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677420 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.677843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.678997 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.679984 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680181 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680620 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.680931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681646 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.681956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.682891 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.683858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684074 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684169 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684704 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.684804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.685952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686053 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686579 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.686917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.687960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688256 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688459 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.688921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689530 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689680 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.689978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.690945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.691912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692215 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692765 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.692859 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693069 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693377 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.693807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694313 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.694944 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695279 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.695906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696208 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.696945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697131 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697576 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.697866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698094 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698381 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698517 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.698972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699112 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699283 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699579 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.699866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700301 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.700922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701069 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701464 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.701934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.702069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.702380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.702479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.702710 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.702809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703759 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.703857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704165 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704386 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704480 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.704787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705110 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705452 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.705976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706411 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.706990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.707860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.708937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709248 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709661 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.709978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.710706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.710809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.710998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711637 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.711946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712251 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712344 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712677 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.712993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713821 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.713936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714752 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.714845 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715495 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715708 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.715809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716126 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.716940 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717044 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717248 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717887 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.717993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718160 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718764 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.718856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719414 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719523 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.719814 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720680 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.720964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721256 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721540 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.721977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722280 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.722874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.723924 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724414 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.724850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.725030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.725159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.725355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.725473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.725686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.726365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.726602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.726756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.726932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727280 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727714 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.727921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728227 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.728939 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729580 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729744 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.729888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730198 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730817 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.730966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731559 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731650 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731871 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.731965 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732272 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732808 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.732899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733203 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733523 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733734 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.733833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734139 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734488 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.734980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735304 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735760 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.735929 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736074 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736388 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.736839 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737467 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737744 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.737842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738251 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738497 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738818 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.738972 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739398 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.739920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740229 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740839 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.740934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741797 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.741890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742215 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.742812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743222 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743359 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.743971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744298 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.744926 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745753 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.745910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746235 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.746882 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.747983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.748084 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.748292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.748396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.748645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.748749 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749320 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749620 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.749902 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750059 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750503 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750804 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.750949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751198 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.751832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752153 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752367 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752539 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752834 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.752980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753417 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753579 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753728 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.753874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754522 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.754835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755151 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755757 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.755969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.756078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.756278 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.756379 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.756587 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.756680 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.757403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.757508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.757747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.757846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758707 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.758931 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759735 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.759953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.760097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.760309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.760411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.760641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.760741 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.761901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.762078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.762210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.762565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.762784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.762887 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763416 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763511 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.763829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764034 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764339 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764648 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.764952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765044 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765374 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.765927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766638 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.766993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767510 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.767911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768235 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.768848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769707 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.769810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770013 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.770977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771310 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.771957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.772051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.772270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.772365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.772640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.772740 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.773447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.773588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.773772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.773900 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774297 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774518 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.774918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775129 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775460 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775568 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.775870 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.776772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777002 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.777941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.778955 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779577 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779670 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.779996 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780313 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780865 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.780972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781493 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781808 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.781911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.782858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783158 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.783821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784336 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784650 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.784968 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785302 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.785937 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.786136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.786275 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.786451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.786763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.786900 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.787828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788416 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788729 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.788829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789491 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.789997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790714 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.790931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791577 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791900 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.791993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.792214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.792317 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.792533 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.792751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.792853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.793831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794049 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794144 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794454 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.794977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795080 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795318 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.795951 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796686 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796894 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.796986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.797206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.797300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.797517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.797628 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.797832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798031 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798142 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798677 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.798772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799098 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799349 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799475 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.799982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800083 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800600 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.800999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801522 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801661 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.801921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802243 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802749 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.802841 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.803061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.803166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.803392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.803486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.803791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.804129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.804455 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.804781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.805103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.805418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.805715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.805811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.806809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807037 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807389 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.807959 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808288 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808617 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.808937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809250 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.809981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.810890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811434 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.811854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812069 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812375 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812680 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812774 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.812995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.813914 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814536 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.814941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815287 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815577 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.815890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816757 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.816850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.817999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818094 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818630 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.818939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.819078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.819265 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.819374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.820991 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.821155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.821484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.821588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.821804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.821971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.822894 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823057 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.823810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824140 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824340 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824650 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.824958 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825059 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825673 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.825985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826504 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.826921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.827860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828688 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.828997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829714 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.829921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830231 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830538 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.830939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831153 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.831897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832109 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832212 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832784 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.832884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833112 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833519 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.833841 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834050 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834374 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.834799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.835091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.835732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.835884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.835982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836218 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836685 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.836945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837163 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.837887 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838409 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.838844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839054 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.839991 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840599 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840744 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.840920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841230 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.841956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842246 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.842858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843163 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843698 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.843793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844451 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.844932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845235 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845336 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.845909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846322 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846862 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.846957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.847116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118038) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:10:14.847209 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.847506 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.847828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.848148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.848465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.848775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.849108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.849419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.849731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.850053 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.850363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.850691 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.851001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.851347 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.851675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.851982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.852309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.852641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.852965 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.853284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.853622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.853931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.854247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.854562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.854877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.855189 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.855524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.855933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.856253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.856582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.856937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.857221 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.857549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.857878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.858274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.858588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.859009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.859355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.862101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.862101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.862101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:10:14.862101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:10:14.909484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO dbcounter [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Registered counter for database nova_api Jun 02 09:10:14.921431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO dbcounter [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Registered counter for database nova_api Jun 02 09:10:14.929777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_db.sqlalchemy.engines [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:14.936690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writer thread running {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:14.942143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_db.sqlalchemy.engines [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:14.949342 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writer thread running {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:14.995008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.context [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2313d202-a844-40de-8f2e-fd9d46062c17(cell1) {{(pid=118038) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 09:10:14.999259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:10:15.000875 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:10:15.001694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:10:15.003800 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:10:15.005893 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO dbcounter [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Registered counter for database nova_cell0 Jun 02 09:10:15.008370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.context [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2313d202-a844-40de-8f2e-fd9d46062c17(cell1) {{(pid=118037) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 09:10:15.010818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO dbcounter [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Registered counter for database nova_cell1 Jun 02 09:10:15.013796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:10:15.015439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:10:15.016260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:10:15.018284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:10:15.018518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_db.sqlalchemy.engines [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.020413 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO dbcounter [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Registered counter for database nova_cell0 Jun 02 09:10:15.020828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_db.sqlalchemy.engines [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.025139 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO dbcounter [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Registered counter for database nova_cell1 Jun 02 09:10:15.032284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_db.sqlalchemy.engines [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.032529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writer thread running {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.035284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_db.sqlalchemy.engines [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.035427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writer thread running {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.044962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writer thread running {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.044962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writer thread running {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.185189 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO dbcounter [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Registered counter for database nova_cell0 Jun 02 09:10:15.192061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_db.sqlalchemy.engines [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118038) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.193722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO dbcounter [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Registered counter for database nova_cell0 Jun 02 09:10:15.197564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writer thread running {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.201183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_db.sqlalchemy.engines [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:10:15.206616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writer thread running {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:10:15.642745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: WARNING keystonemiddleware.auth_token [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:10:15.650482 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: WARNING keystonemiddleware.auth_token [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:10:15.671169 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: WARNING keystonemiddleware.auth_token [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:10:15.678624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: WARNING keystonemiddleware.auth_token [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:10:15.874237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: WARNING keystonemiddleware.auth_token [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:10:15.880297 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: WARNING keystonemiddleware.auth_token [None req-9ddd9835-8fa6-443f-be4f-67cab8e6871e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:10:15.885435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559898cb99c0 pid: 118038 (default app) Jun 02 09:10:15.902651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: WARNING keystonemiddleware.auth_token [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 09:10:15.908620 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: WARNING keystonemiddleware.auth_token [None req-95e8f9fd-b7cb-44ec-9cc8-5201d6cd1dfb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 09:10:15.914558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559898cb99c0 pid: 118037 (default app) Jun 02 09:10:57.545676 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.546537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.547494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:57.548425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:10:58.804495 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0b5ee98c-ba8d-423a-9e38-b1e6a09c06b4 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Action: 'create', calling method: .version_select at 0x7f96722c63a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-425338953"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:01.901477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0b5ee98c-ba8d-423a-9e38-b1e6a09c06b4 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.315120 Jun 02 09:11:01.901477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1154 bytes} [Thu Jun 2 09:10:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4318 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 09:11:02.468840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c47e6ea0-045f-4748-bd9d-ba6a3b837551 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9672371430>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:02.544814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:02.547247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:02.549878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:02.552239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:02.559818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1025903101", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "networks": [{"uuid": "92d4b2b1-a1f8-4efe-b8e2-a7a3f02eddd4"}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:02.813407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] validate_networks() for [('92d4b2b1-a1f8-4efe-b8e2-a7a3f02eddd4', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:11:03.114635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c47e6ea0-045f-4748-bd9d-ba6a3b837551 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 200 len: 344 microversion: 2.1 time: 1.252504 Jun 02 09:11:03.115563 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:01 2022] GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 344 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:04.129532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-74841180-b04a-4453-89af-72318d91a58f tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96721855e0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:04.414007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:11:04.414561 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:11:04.415367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:11:04.415925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:11:04.416481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:11:04.434299 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:04.434751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:04.435862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:04.440714 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:04.517502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Getting quotas for project 088ecec3bdbf404fa8474235018235ca. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:04.535438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Getting quotas for user c99330cccfea41abbb7bc5b34956c612 and project 088ecec3bdbf404fa8474235018235ca. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:04.563990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:11:04.574827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:11:04.576767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-74841180-b04a-4453-89af-72318d91a58f tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 200 len: 345 microversion: 2.1 time: 0.452282 Jun 02 09:11:04.583930 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:04 2022] GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 345 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:04.591685 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9724a998-4520-44e0-8590-88a0404b4fba tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Action: 'create', calling method: .version_select at 0x7f96721850d0>, body: {"snapshot": {"volume_id": "1934df1b-4166-425e-a71e-1f65fdefe217", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1730720708"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:04.853683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4e062d6d-67a5-470e-83de-695ecc647138 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.614013 Jun 02 09:11:04.860404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 2/4] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 09:11:04.868600 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a6814470-e478-47ce-9f30-f5474a003dd7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:04.869389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a6814470-e478-47ce-9f30-f5474a003dd7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:05.007699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a6814470-e478-47ce-9f30-f5474a003dd7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:05.043722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a6814470-e478-47ce-9f30-f5474a003dd7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1215 microversion: 2.1 time: 0.181669 Jun 02 09:11:05.044329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:04 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:05.450309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9724a998-4520-44e0-8590-88a0404b4fba tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.864146 Jun 02 09:11:05.451515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 3/6] 10.222.0.18 () {60 vars in 1161 bytes} [Thu Jun 2 09:11:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:11:05.462075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fb0c0ff8-a5f6-4ffc-b6c1-0f58f3df1e65 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9671835e50>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:05.762645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fb0c0ff8-a5f6-4ffc-b6c1-0f58f3df1e65 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 287 microversion: 2.1 time: 0.304547 Jun 02 09:11:05.763956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:05 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 287 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:05.774012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b4ed7fa4-fe43-4ebf-8571-c1f9b736e451 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9672193160>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:05.931203 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b4ed7fa4-fe43-4ebf-8571-c1f9b736e451 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.161332 Jun 02 09:11:05.937363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1139 bytes} [Thu Jun 2 09:11:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:05.948422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2f1c5e9b-0218-484c-a4c8-d447b5e1d476 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9670fe05e0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:06.061104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-184c0287-fc44-4bfa-8299-2d2f80d6a748 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:06.062208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-184c0287-fc44-4bfa-8299-2d2f80d6a748 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:06.112623 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2f1c5e9b-0218-484c-a4c8-d447b5e1d476 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 287 microversion: 2.1 time: 0.169097 Jun 02 09:11:06.114901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:05 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:06.224864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-184c0287-fc44-4bfa-8299-2d2f80d6a748 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:06.249747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-184c0287-fc44-4bfa-8299-2d2f80d6a748 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1215 microversion: 2.1 time: 0.192399 Jun 02 09:11:06.260015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:06 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:06.314648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d3ee3bcc-083d-4e6c-ae4f-2f11a84536d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: .version_select at 0x7f9670fe0c10>, body: {"keypair": {"name": "tempest-keypair-1900334956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOXd2XazYur2qn3auet2KpDwMSDKNtxh7NoguVUuOlryVpdQwtv7S38WEX8jkXg6uTclnJrC8mX2mvgFCfJg3v4RqsO56Uwc3ZR48J/DgCfYfRqqEwGDVgXHphM158kYw=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:06.356860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-d3ee3bcc-083d-4e6c-ae4f-2f11a84536d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for project 597dc461d8a042e19ad99324a626aac1. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:06.363222 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-d3ee3bcc-083d-4e6c-ae4f-2f11a84536d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for user 0d89a238fc8047cdaaac1047a675cfbb and project 597dc461d8a042e19ad99324a626aac1. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:06.526992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d3ee3bcc-083d-4e6c-ae4f-2f11a84536d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284377 Jun 02 09:11:06.527625 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 6/11] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:11:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:07.132964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e446c8d5-5708-4732-a81d-2742c338301d tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9672185940>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:07.173433 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e446c8d5-5708-4732-a81d-2742c338301d tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 287 microversion: 2.1 time: 0.050914 Jun 02 09:11:07.174309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:07 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:07.266761 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-622f59b8-ab9e-40f8-bef6-23334ca57972 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:07.267896 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-622f59b8-ab9e-40f8-bef6-23334ca57972 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:07.371704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-622f59b8-ab9e-40f8-bef6-23334ca57972 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:07.386431 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-622f59b8-ab9e-40f8-bef6-23334ca57972 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1215 microversion: 2.1 time: 0.124110 Jun 02 09:11:07.387853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:07 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:08.190075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-55d1acbf-f472-46a3-a716-761a279438fc tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96720e81f0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:08.248692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-55d1acbf-f472-46a3-a716-761a279438fc tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 287 microversion: 2.1 time: 0.067257 Jun 02 09:11:08.249950 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:08 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:08.405526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:08.405526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:08.419636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:08.421314 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:08.421314 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:08.421464 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:08.677550 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:08.700569 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3cf5ed16-34a9-4b26-a26f-2f1ea46e590b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1219 microversion: 2.1 time: 0.300962 Jun 02 09:11:08.701746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 8/15] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:08 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:09.261321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-763a84aa-a37e-489b-8241-348960628fbb tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96720e88b0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:09.327819 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-763a84aa-a37e-489b-8241-348960628fbb tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 288 microversion: 2.1 time: 0.071380 Jun 02 09:11:09.328457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:09 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:09.340569 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4108af59-e3c5-45f9-bd48-4c2fa1b76717 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9670786040>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:09.498782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4108af59-e3c5-45f9-bd48-4c2fa1b76717 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 202 len: 0 microversion: 2.1 time: 0.163175 Jun 02 09:11:09.499974 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1253 bytes} [Thu Jun 2 09:11:09 2022] DELETE /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:11:09.508295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3a2821e5-92cb-4a6a-b775-d96028a45a96 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9672154f70>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:09.556440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3a2821e5-92cb-4a6a-b775-d96028a45a96 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 200 len: 287 microversion: 2.1 time: 0.052814 Jun 02 09:11:09.557653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 9/18] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:09 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:09.718995 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:09.720027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:09.733003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:09.733633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:09.734596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:09.735185 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:10.365210 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:10.381922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a98274be-e02f-48cc-9cdc-e51dd9342b55 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1211 microversion: 2.1 time: 0.667410 Jun 02 09:11:10.383338 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 10/19] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:09 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1211 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:10.568450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d303b48b-f1d3-4e37-b8d0-ae10e124ac4b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96720e8b80>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:10.642682 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-d303b48b-f1d3-4e37-b8d0-ae10e124ac4b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] HTTP exception thrown: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d303b48b-f1d3-4e37-b8d0-ae10e124ac4b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Request method failure captured: Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 HTTP/1.1 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6h-c0GEmp8TIyEifJQoQO4h_wU5kI8pb12zHHmCutB3Htmq58zKFVqN_rRHElKuKeqq44q7b30zjdo0DwjMJXdwCNev1Zw-NX1CxfWs2XozKe89ZnSqooucj0rgu7QKqqhfcrs3F6tmVe8m9r0QqjV5R75udSRKRogG_acszOyDZ4 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:10.648328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/783b51e86d404ac5af434056d55e797f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_783b51e86d404ac5af434056d55e797f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: aac67129a0da48658220b42f27a33f45 Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '6197642a-476c-4300-a235-738e71e105d4'} Jun 02 09:11:10.653126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. (HTTP 404) (Request-ID: req-06a207bb-0860-4233-9bb4-f0b3f0c3a113) Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.653903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:10.655515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 09:11:10.656385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d303b48b-f1d3-4e37-b8d0-ae10e124ac4b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Returning 404 to user: Snapshot 6197642a-476c-4300-a235-738e71e105d4 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d303b48b-f1d3-4e37-b8d0-ae10e124ac4b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4" status: 404 len: 111 microversion: 2.1 time: 0.085927 Jun 02 09:11:10.657319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 10/20] 10.222.0.18 () {58 vars in 1250 bytes} [Thu Jun 2 09:11:10 2022] GET /compute/v2.1/os-snapshots/6197642a-476c-4300-a235-738e71e105d4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:11:10.659863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0750995a-414d-43a1-aa75-11ee71be6d69 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96707868b0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:10.779791 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2023688611", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46dd9852-216f-49d7-b4d1-ee3ded9a21b2"}], "security_groups": [{"name": "tempest-securitygroup--1704072414"}], "key_name": "tempest-keypair-1900334956", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:10.997829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] validate_networks() for [('46dd9852-216f-49d7-b4d1-ee3ded9a21b2', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:11:11.123502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0750995a-414d-43a1-aa75-11ee71be6d69 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 202 len: 0 microversion: 2.1 time: 0.467460 Jun 02 09:11:11.127264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:11:10 2022] DELETE /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:11:11.132902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64f6061c-99d1-4779-a559-219abaf85d00 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f9670786280>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:11.485133 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-64f6061c-99d1-4779-a559-219abaf85d00 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 200 len: 344 microversion: 2.1 time: 0.356470 Jun 02 09:11:11.486053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 12/22] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:11 2022] GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 344 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:11.494861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:11.495703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:11.519220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:11.527503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:11.536698 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:11.537747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:11.769729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:11.787026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4ac7cf18-bd48-42d6-b93e-985fce0b84a1 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1285 microversion: 2.1 time: 0.299741 Jun 02 09:11:11.788608 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 13/23] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:11 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1285 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:12.688901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:11:12.689406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:11:12.689829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:11:12.690311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:11:12.690791 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:11:12.721866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:12.723155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:12.725393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:12.727581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:12.766856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-261f844c-c672-4c5f-8ea0-23f0c54705a5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: .version_select at 0x7f9670791040>, body: {"keypair": {"name": "tempest-keypair-259203824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAh1MjuDk59BzSKbZDHGq4piPJlOYx1nm6SZsVBYlPXywYMIAMNOFyu979qar4yK7AwoNV2tJxICzhtb+neWsTxbTyQCESHEx5H3IDQARLNzKpIkSC0gstK+lNmOk/QUA=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:12.798229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-261f844c-c672-4c5f-8ea0-23f0c54705a5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for project 24a81b035f834106b49c35c847f246d6. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:12.804424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-261f844c-c672-4c5f-8ea0-23f0c54705a5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for user 58b706e007fa46c7b8a69508455fcdba and project 24a81b035f834106b49c35c847f246d6. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:12.841272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for project 597dc461d8a042e19ad99324a626aac1. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:12.859748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for user 0d89a238fc8047cdaaac1047a675cfbb and project 597dc461d8a042e19ad99324a626aac1. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:12.899432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:11:12.902834 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:11:12.908939 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-261f844c-c672-4c5f-8ea0-23f0c54705a5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.469424 Jun 02 09:11:12.910135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 14/24] 10.222.0.18 () {62 vars in 1199 bytes} [Thu Jun 2 09:11:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 471 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 09:11:12.943986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c023900c-63a3-427b-aeab-635f8d7b2c94 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96706ee4c0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:13.000545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-c023900c-63a3-427b-aeab-635f8d7b2c94 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] HTTP exception thrown: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c023900c-63a3-427b-aeab-635f8d7b2c94 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Request method failure captured: Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 HTTP/1.1 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6h-c0GEmp8TIyEifJQoQO4h_wU5kI8pb12zHHmCutB3Htmq58zKFVqN_rRHElKuKeqq44q7b30zjdo0DwjMJXdwCNev1Zw-NX1CxfWs2XozKe89ZnSqooucj0rgu7QKqqhfcrs3F6tmVe8m9r0QqjV5R75udSRKRogG_acszOyDZ4 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:11:13.018058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/783b51e86d404ac5af434056d55e797f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_783b51e86d404ac5af434056d55e797f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: aac67129a0da48658220b42f27a33f45 Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '1934df1b-4166-425e-a71e-1f65fdefe217'} Jun 02 09:11:13.019148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. (HTTP 404) (Request-ID: req-48cf4074-9c7c-474f-bcea-b64c6ff9c65f) Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:13.021012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 09:11:13.022017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c023900c-63a3-427b-aeab-635f8d7b2c94 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Returning 404 to user: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:13.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c023900c-63a3-427b-aeab-635f8d7b2c94 tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 404 len: 109 microversion: 2.1 time: 0.108575 Jun 02 09:11:13.028498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 15/25] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:12 2022] GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:13.042495 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:13.045686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:13.065052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:13.065551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:13.066432 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:13.069516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:13.211049 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-53d1f78b-4fb4-41fd-a926-73cca3ed0176 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.435911 Jun 02 09:11:13.217766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 11/26] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:11:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 09:11:13.223528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-548a4191-c84b-43ca-8fb4-7498b0b2727b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96717a8ca0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:13.302167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-548a4191-c84b-43ca-8fb4-7498b0b2727b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] HTTP exception thrown: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-548a4191-c84b-43ca-8fb4-7498b0b2727b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Request method failure captured: Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 HTTP/1.1 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6h-c0GEmp8TIyEifJQoQO4h_wU5kI8pb12zHHmCutB3Htmq58zKFVqN_rRHElKuKeqq44q7b30zjdo0DwjMJXdwCNev1Zw-NX1CxfWs2XozKe89ZnSqooucj0rgu7QKqqhfcrs3F6tmVe8m9r0QqjV5R75udSRKRogG_acszOyDZ4 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:13.305618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/783b51e86d404ac5af434056d55e797f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_783b51e86d404ac5af434056d55e797f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: aac67129a0da48658220b42f27a33f45 Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '1934df1b-4166-425e-a71e-1f65fdefe217'} Jun 02 09:11:13.306932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. (HTTP 404) (Request-ID: req-8dc46035-eacc-4d7d-a03c-ff8fee96894a) Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.307665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:13.308645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 09:11:13.309541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.311059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.328976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-548a4191-c84b-43ca-8fb4-7498b0b2727b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Returning 404 to user: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:13.328976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-548a4191-c84b-43ca-8fb4-7498b0b2727b tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 404 len: 109 microversion: 2.1 time: 0.094567 Jun 02 09:11:13.328976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 12/27] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:11:13 2022] DELETE /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:13.335425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4bb8d57b-b29e-46f9-87cd-ddc962b97bc6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:13.336351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4bb8d57b-b29e-46f9-87cd-ddc962b97bc6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:13.347743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:13.360045 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a8b18bdc-854b-4a99-894a-ad05e8e7963f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1273 microversion: 2.1 time: 0.324445 Jun 02 09:11:13.360628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:13 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:13.434814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4bb8d57b-b29e-46f9-87cd-ddc962b97bc6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:13.442938 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4bb8d57b-b29e-46f9-87cd-ddc962b97bc6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1238 microversion: 2.1 time: 0.126054 Jun 02 09:11:13.449653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 13/29] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:13 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1238 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:13.458755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d244c16f-ae0a-4bff-b820-0573a658c8ad tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Calling method '.version_select at 0x7f96717d0ca0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:13.487166 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-995206103", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:13.527456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-d244c16f-ae0a-4bff-b820-0573a658c8ad tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] HTTP exception thrown: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d244c16f-ae0a-4bff-b820-0573a658c8ad tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Request method failure captured: Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 HTTP/1.1 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6h-c0GEmp8TIyEifJQoQO4h_wU5kI8pb12zHHmCutB3Htmq58zKFVqN_rRHElKuKeqq44q7b30zjdo0DwjMJXdwCNev1Zw-NX1CxfWs2XozKe89ZnSqooucj0rgu7QKqqhfcrs3F6tmVe8m9r0QqjV5R75udSRKRogG_acszOyDZ4 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:13.528967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/783b51e86d404ac5af434056d55e797f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/783b51e86d404ac5af434056d55e797f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_783b51e86d404ac5af434056d55e797f", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 783b51e86d404ac5af434056d55e797f Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-735989163 Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: aac67129a0da48658220b42f27a33f45 Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesSnapshotsTestJSON-735989163-project Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '1934df1b-4166-425e-a71e-1f65fdefe217'} Jun 02 09:11:13.530307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. (HTTP 404) (Request-ID: req-66589217-96b7-43a0-907c-7bf43c640f69) Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.531081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:13.535211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 09:11:13.536502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d244c16f-ae0a-4bff-b820-0573a658c8ad tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] Returning 404 to user: Volume 1934df1b-4166-425e-a71e-1f65fdefe217 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d244c16f-ae0a-4bff-b820-0573a658c8ad tempest-VolumesSnapshotsTestJSON-735989163 tempest-VolumesSnapshotsTestJSON-735989163-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217" status: 404 len: 109 microversion: 2.1 time: 0.079482 Jun 02 09:11:13.538102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 14/30] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:13 2022] GET /compute/v2.1/os-volumes/1934df1b-4166-425e-a71e-1f65fdefe217 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:13.602157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] validate_networks() for [('1ffec283-4d25-408f-ae56-198b57483577', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:11:14.304921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:11:14.308818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:11:14.312142 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:11:14.312993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:11:14.314904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:11:14.335574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:14.337224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:14.338477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:14.339268 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:14.364752 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:14.371619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for user bc0272ac06464fb7b430bc8c664208dd and project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:14.380918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:14.381872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:14.400646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:14.403041 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:14.406023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:14.406849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:14.443941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:11:14.449337 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:11:14.692808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-df08276b-d0b8-4417-a3df-6a5635af726f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.330973 Jun 02 09:11:14.701007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 17/31] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:11:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:11:14.726516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-47488926-7cc2-4b1c-b03d-81b5b3fc084a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:14.753594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-47488926-7cc2-4b1c-b03d-81b5b3fc084a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:14.970802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:14.996649 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d6bf85a8-0621-49aa-8443-be94913456e7 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1273 microversion: 2.1 time: 0.621501 Jun 02 09:11:14.998956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 15/32] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:14 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1273 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:15.011945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-72ff9df9-f3bf-46b0-a053-73fd843ece64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:15.013249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-72ff9df9-f3bf-46b0-a053-73fd843ece64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:15.096812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-47488926-7cc2-4b1c-b03d-81b5b3fc084a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:15.107456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-47488926-7cc2-4b1c-b03d-81b5b3fc084a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1238 microversion: 2.1 time: 0.404747 Jun 02 09:11:15.108407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 18/33] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:14 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1238 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:15.215675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-72ff9df9-f3bf-46b0-a053-73fd843ece64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:15.254933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-72ff9df9-f3bf-46b0-a053-73fd843ece64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1221 microversion: 2.1 time: 0.254253 Jun 02 09:11:15.259164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 16/34] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:14 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:15.490154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-723593348", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:15.653672 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] validate_networks() for [('1ffec283-4d25-408f-ae56-198b57483577', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:11:16.017168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:16.017912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:16.059267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:16.059267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:16.059267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:16.059267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:16.588406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:16.597920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b0a8440e-e46c-43e4-b4c8-1599a49a51a3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1273 microversion: 2.1 time: 0.586706 Jun 02 09:11:16.627003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 17/35] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:16 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1273 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:16.640547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:16.642868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:16.674391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:16.680157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:16.683545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:16.683545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:16.882188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:16.912259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-48a33c52-f5a1-4daf-add9-6b435ede008d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1242 microversion: 2.1 time: 0.283495 Jun 02 09:11:16.916174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 18/36] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:16 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1242 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:17.489557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:11:17.489557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:11:17.489557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:11:17.489557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:11:17.489557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:11:17.491595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:17.491595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:17.491595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:17.491595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:17.527282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:17.533827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for user bc0272ac06464fb7b430bc8c664208dd and project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:17.591446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:11:17.612916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:11:17.635731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:17.637684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:17.649939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:17.650693 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:17.653260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:17.655348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:17.895092 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4a52a133-2ec4-4024-b1a1-d53fca2c7e78 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.404783 Jun 02 09:11:17.897948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 19/37] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:11:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:11:17.938805 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d352bb9b-955a-4377-b435-20f40b8ac4a6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:17.945883 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d352bb9b-955a-4377-b435-20f40b8ac4a6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:18.230330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d352bb9b-955a-4377-b435-20f40b8ac4a6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:18.249934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d352bb9b-955a-4377-b435-20f40b8ac4a6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1221 microversion: 2.1 time: 0.337345 Jun 02 09:11:18.251030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 20/38] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:17 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:18.261324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:18.261890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:18.272951 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:18.274137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:18.275659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:18.276287 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:18.524133 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:18.537608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03bd16b5-60f0-4e6d-9671-f05b6de5d471 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.907312 Jun 02 09:11:18.552528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 19/39] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:17 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:18.645533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:18.679724 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1ca85d9e-1224-4f96-bb5c-87963d38aec7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1290 microversion: 2.1 time: 0.410423 Jun 02 09:11:18.683578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:18 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1290 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:19.284234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-de22517f-b9f3-481f-8adf-58dbc56c48ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:19.285748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-de22517f-b9f3-481f-8adf-58dbc56c48ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:19.570699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:19.571400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:19.580444 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:19.602053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:19.607045 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:19.609513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:19.611053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:19.875719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-de22517f-b9f3-481f-8adf-58dbc56c48ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:19.889148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-de22517f-b9f3-481f-8adf-58dbc56c48ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1221 microversion: 2.1 time: 0.623081 Jun 02 09:11:19.903581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:19 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1221 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:19.916281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:19.918999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:19.955695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:19.955695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:19.958953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:19.961247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:20.602529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:20.610634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dc40187a-42d9-4ced-a893-394856104993 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1308 microversion: 2.1 time: 0.705741 Jun 02 09:11:20.615437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:19 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:20.832508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:20.848812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b10218a9-ac90-4c0e-b8c9-d3f80241fd07 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 1.293172 Jun 02 09:11:20.853202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:19 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:20.913567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:20.915572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:20.964557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:20.967298 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:20.968803 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:20.977021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:21.344450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-766b8abb-26a8-4fd5-95ea-ecde5f50b1eb tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Action: 'create', calling method: .version_select at 0x7f9670f12b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1932296417", "metadata": {"Type": "work"}}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-766b8abb-26a8-4fd5-95ea-ecde5f50b1eb tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 122 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:21.359796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1932296417", "metadata": {"Type": "work"}}} Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:21.361125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1932296417', 'metadata': {'Type': 'work'}}}} Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise error Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:21.361974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 09:11:21.363400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 09:11:21.364545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 09:11:21.364545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.367257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-766b8abb-26a8-4fd5-95ea-ecde5f50b1eb tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:21.368483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-766b8abb-26a8-4fd5-95ea-ecde5f50b1eb tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.751010 Jun 02 09:11:21.369495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 22/44] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 2 09:11:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 752 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:11:21.378843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b3244c92-628f-4c0e-aad9-a2d7dacd5e33 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Action: 'create', calling method: .version_select at 0x7f9670f414c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2045313199", "metadata": {"Type": "work"}}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b3244c92-628f-4c0e-aad9-a2d7dacd5e33 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 120 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:21.387612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2045313199", "metadata": {"Type": "work"}}} Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:21.388908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2045313199', 'metadata': {'Type': 'work'}}}} Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise error Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi '0' Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:21.389595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 09:11:21.390694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 09:11:21.391852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 09:11:21.391852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.399049 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b3244c92-628f-4c0e-aad9-a2d7dacd5e33 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:21.401676 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b3244c92-628f-4c0e-aad9-a2d7dacd5e33 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026294 Jun 02 09:11:21.411877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 2 09:11:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 02 09:11:21.424155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d69bde6c-bf99-43a1-8de8-cfecfb0e8356 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Action: 'create', calling method: .version_select at 0x7f96717a89d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1304930733", "metadata": {"Type": "work"}}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:21.427129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:21.441844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-14f63a44-4572-4531-9618-39dd10f81034 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1273 microversion: 2.1 time: 0.537400 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d69bde6c-bf99-43a1-8de8-cfecfb0e8356 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 119 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:21.443007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1304930733", "metadata": {"Type": "work"}}} Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:21.444653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1304930733', 'metadata': {'Type': 'work'}}}} Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise error Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi '' Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:21.445293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 09:11:21.447055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 09:11:21.448372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 09:11:21.448372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.452222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d69bde6c-bf99-43a1-8de8-cfecfb0e8356 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:21.456304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 23/46] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:20 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1273 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:21.465829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d69bde6c-bf99-43a1-8de8-cfecfb0e8356 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.046011 Jun 02 09:11:21.469758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 24/47] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 2 09:11:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 02 09:11:21.484675 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-97701d82-2d2d-4c78-ae02-f3e396ed3ba1 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Calling method '.version_select at 0x7f9670753ca0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:21.564791 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-642762309", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84967763-57f4-4c53-b6ef-7ebe9732f7b0"}], "security_groups": [{"name": "tempest-securitygroup--818571518"}], "key_name": "tempest-keypair-259203824", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:21.947562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-97701d82-2d2d-4c78-ae02-f3e396ed3ba1 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] HTTP exception thrown: Volume tempest-invalid-1934052610 could not be found. Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-97701d82-2d2d-4c78-ae02-f3e396ed3ba1 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1934052610 HTTP/1.1 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:11:21.951633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Volume tempest-invalid-1934052610 could not be found. Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'tempest-invalid-1934052610'} Jun 02 09:11:21.952938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1934052610 could not be found. (HTTP 404) (Request-ID: req-049c15c2-efd7-4878-92e6-65d605693d59) Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.953624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:21.954536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1934052610 could not be found. Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:21.959871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1934052610 could not be found. Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1934052610 could not be found. Jun 02 09:11:21.963606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:21.967204 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-97701d82-2d2d-4c78-ae02-f3e396ed3ba1 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 404 to user: Volume tempest-invalid-1934052610 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:21.970612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-97701d82-2d2d-4c78-ae02-f3e396ed3ba1 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1934052610" status: 404 len: 99 microversion: 2.1 time: 0.489523 Jun 02 09:11:21.979145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 2 09:11:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1934052610 => generated 99 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 02 09:11:21.990544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:21.993796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:22.010224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:22.011253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:22.012277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:22.013245 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:22.201112 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:22.212016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b80ac6db-6c03-4fda-9124-744592171d19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1296 microversion: 2.1 time: 0.231107 Jun 02 09:11:22.215110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 25/49] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:21 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1296 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:22.225052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] validate_networks() for [('84967763-57f4-4c53-b6ef-7ebe9732f7b0', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:11:22.229426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:22.234105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:22.251711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:22.252583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:22.254427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:22.255813 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:22.794407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:23.577291 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:23.605595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-29ab38c0-1f1f-4a2b-8b2f-09b4a9545da6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 1.385614 Jun 02 09:11:23.614692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 26/50] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:22 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:23.636947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9ba1e1ce-033c-496d-892f-55338e81abf2 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022416 Jun 02 09:11:23.638978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 27/51] 10.222.0.18 () {58 vars in 1139 bytes} [Thu Jun 2 09:11:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 09:11:23.654859 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:23.656369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:23.680798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:23.681979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:23.683471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:23.684145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.025483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:24.031010 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ef75dfed-e955-4fb0-99e2-22d06f21fb48 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1279 microversion: 2.1 time: 0.389951 Jun 02 09:11:24.048146 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 28/52] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:23 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:24.164120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-436c9756-b72d-468f-8b9b-afdf2262cb47 req-2ad0c78f-7612-43a8-ad9c-220406c6c28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f49ccd0-ef5e-4ead-8f24-4504c183a9cb", "tag": "036c52c3-66e8-4a2a-900c-787f3c21fa59"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:24.206731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-436c9756-b72d-468f-8b9b-afdf2262cb47 req-2ad0c78f-7612-43a8-ad9c-220406c6c28e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.211780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-436c9756-b72d-468f-8b9b-afdf2262cb47 req-2ad0c78f-7612-43a8-ad9c-220406c6c28e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.276256 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-436c9756-b72d-468f-8b9b-afdf2262cb47 req-2ad0c78f-7612-43a8-ad9c-220406c6c28e service nova] Creating event network-changed:036c52c3-66e8-4a2a-900c-787f3c21fa59 for instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb on hv-cinder-82549 Jun 02 09:11:24.277595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-436c9756-b72d-468f-8b9b-afdf2262cb47 req-2ad0c78f-7612-43a8-ad9c-220406c6c28e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118038) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 09:11:24.278792 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.279259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.280056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.280489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.302564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.compute.rpcapi [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 09:11:24.309142 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] Releasing lock "compute-rpcapi-router" {{(pid=118038) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 09:11:24.342033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7dd1f53d-6af9-4ae3-9be1-c21a3030bd4c None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290833 Jun 02 09:11:24.343989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 29/53] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:24.380227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:24.382954 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:24.397474 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.398161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.399011 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.399477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.874349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:24.892136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f61f8e6d-eb64-469f-bd46-95b5cb3864cc tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1296 microversion: 2.1 time: 0.543892 Jun 02 09:11:24.894063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 30/54] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:24 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1296 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:24.905214 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-70c326fc-4157-4a72-9c70-3e7c5af28557 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007704 Jun 02 09:11:24.905858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 31/55] 10.222.0.18 () {58 vars in 1136 bytes} [Thu Jun 2 09:11:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 09:11:24.938962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:24.945108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:24.957285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.958076 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:24.959138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:24.960055 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:25.091306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:11:25.091822 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:11:25.092210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:11:25.105340 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:11:25.105941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:11:25.140994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:25.141436 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:25.142168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:25.142614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:25.205004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for project 24a81b035f834106b49c35c847f246d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:11:25.215646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for user 58b706e007fa46c7b8a69508455fcdba and project 24a81b035f834106b49c35c847f246d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:11:25.246978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:11:25.252226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:11:25.358903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:25.373578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-02320b48-a36c-4306-abc3-b8771c55e921 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.459700 Jun 02 09:11:25.374422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 32/56] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:24 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:25.393768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-01bbf7d2-8fb7-4f91-9693-63b5cafe8777 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Calling method '.version_select at 0x7f967068cd30>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:25.474882 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-01bbf7d2-8fb7-4f91-9693-63b5cafe8777 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] HTTP exception thrown: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-01bbf7d2-8fb7-4f91-9693-63b5cafe8777 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/os-volumes/0297a315-7d6a-4227-9c90-85137a851595 HTTP/1.1 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:11:25.478835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '0297a315-7d6a-4227-9c90-85137a851595'} Jun 02 09:11:25.480056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. (HTTP 404) (Request-ID: req-2f4b28c9-9b6b-4bb9-9b8a-6430df036eda) Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.480721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 09:11:25.481649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 09:11:25.482557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. Jun 02 09:11:25.483531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.487819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-01bbf7d2-8fb7-4f91-9693-63b5cafe8777 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 404 to user: Volume 0297a315-7d6a-4227-9c90-85137a851595 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:25.489193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-01bbf7d2-8fb7-4f91-9693-63b5cafe8777 tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/0297a315-7d6a-4227-9c90-85137a851595" status: 404 len: 109 microversion: 2.1 time: 0.111608 Jun 02 09:11:25.496986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 33/57] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:11:25 2022] DELETE /compute/v2.1/os-volumes/0297a315-7d6a-4227-9c90-85137a851595 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:25.503954 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-69117316-1d2d-48fc-b17b-28bedb7efb45 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.943918 Jun 02 09:11:25.506272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 25/58] 10.222.0.18 () {62 vars in 1187 bytes} [Thu Jun 2 09:11:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 09:11:25.510991 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1522c98c-de9e-4fb3-8f95-5eb1e9be0c0e tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Calling method '.version_select at 0x7f9670f581f0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:25.518172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:25.519721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:25.558295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:25.563176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:25.564191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:25.580077 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:25.603952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-1522c98c-de9e-4fb3-8f95-5eb1e9be0c0e tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] HTTP exception thrown: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1522c98c-de9e-4fb3-8f95-5eb1e9be0c0e tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Request method failure captured: Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/os-volumes/8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee HTTP/1.1 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH64fkcexCDgVcUGU6_iNzLwcknwnLLIitr0DasoX84_aNL9dGiryYejoKIpJxVbCGek7Xvd8_U5RZ58EZCgx0lcLxOZabExGrHO8qhAZiVoorAO4ncVtbO9FUXq-KpQ1pe7l-PJ8mNzb_jN4YMV6xHU2QPR7bVr8XwRZ5jFboRxLdk Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:11:25.605911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e021cf43509449b88c5d1a88b19055f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e021cf43509449b88c5d1a88b19055f5", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: e021cf43509449b88c5d1a88b19055f5 Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesNegativeTest-1166576739 Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 1dff08414fa44d35857a77e53935609a Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesNegativeTest-1166576739-project Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee'} Jun 02 09:11:25.607008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. (HTTP 404) (Request-ID: req-8add1c2f-4aff-4fc3-b742-10b6f7b49e76) Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.607672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:11:25.608622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 09:11:25.609602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1522c98c-de9e-4fb3-8f95-5eb1e9be0c0e tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] Returning 404 to user: Volume 8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:11:25.610507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1522c98c-de9e-4fb3-8f95-5eb1e9be0c0e tempest-VolumesNegativeTest-1166576739 tempest-VolumesNegativeTest-1166576739-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee" status: 404 len: 109 microversion: 2.1 time: 0.100065 Jun 02 09:11:25.622185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 26/59] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:11:25 2022] GET /compute/v2.1/os-volumes/8ed7fc04-efde-470e-a32e-cd8b4d4aa3ee => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:11:25.648082 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:25.648719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:26.044940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:26.053111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:26.054415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:26.055582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-be3a550b-c6a3-440e-a11d-054593c343ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1280 microversion: 2.20 time: 0.431546 Jun 02 09:11:26.056145 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 27/60] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:25 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1280 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:26.098694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:26.102349 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:26.126706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:26.127666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:26.128491 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:26.133246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:26.289423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:26.305742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9c502552-c51d-424c-857a-a6db110839ef tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.812768 Jun 02 09:11:26.306496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 34/61] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:25 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:26.391952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:26.392667 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:26.401728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:26.408807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:26.409911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:26.410426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:26.883479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:26.914879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5eb0273e-32e1-4bbc-bb65-d3b822556875 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.854808 Jun 02 09:11:26.915611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:26 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:27.089276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:27.100639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:27.100639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:27.101822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-00987eab-fb42-4e06-a5c3-339310485b86 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.709896 Jun 02 09:11:27.103870 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 35/63] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:26 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:27.103980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.104521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:27.105357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.114088 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:27.322656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:27.324299 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:27.331188 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.332003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:27.333218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:27.334193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.335141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:27.360383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:27.368635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:27.369850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-297efae1-5758-44f5-8cd4-f13633136b87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1284 microversion: 2.20 time: 0.297213 Jun 02 09:11:27.373489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 29/64] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:27 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:27.933124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:27.933757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:27.948751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.949287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:27.953191 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:27.953724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:28.094767 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:28.097289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=99 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:28.112023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6efa5150-15f5-4745-898d-a7ac20fff04a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.793774 Jun 02 09:11:28.112607 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 36/65] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:27 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:28.152748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:28.153471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:28.172148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:28.172933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:28.185217 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:28.187830 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:28.245989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=34 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:29.399698 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:29.415081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cd3b1967-8012-431e-b23e-03ac0ab0c132 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 1.485946 Jun 02 09:11:29.429198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 30/66] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:27 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:29.446665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:29.449690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:29.450215 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:29.461364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7e09f117-ab3b-4ad9-9cc1-ccfc17435080 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 1.329030 Jun 02 09:11:29.466370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:29.468361 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:29.473259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:29.473259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:29.473540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 37/67] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:28 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:29.507829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-7d800fdb-e4c3-4a67-a15b-54e6f1b877a6 req-eb4291ee-e967-4fb3-8519-ebad3469756a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "985c0064-b00b-4cd5-8a5a-879b9c2b20a3", "tag": "1ade0213-9d25-4fe3-9205-a852bd57287c"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:29.536760 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-7d800fdb-e4c3-4a67-a15b-54e6f1b877a6 req-eb4291ee-e967-4fb3-8519-ebad3469756a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:29.537448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-7d800fdb-e4c3-4a67-a15b-54e6f1b877a6 req-eb4291ee-e967-4fb3-8519-ebad3469756a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:29.591711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-7d800fdb-e4c3-4a67-a15b-54e6f1b877a6 req-eb4291ee-e967-4fb3-8519-ebad3469756a service nova] Creating event network-changed:1ade0213-9d25-4fe3-9205-a852bd57287c for instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 on hv-cinder-82549 Jun 02 09:11:29.591711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-7d800fdb-e4c3-4a67-a15b-54e6f1b877a6 req-eb4291ee-e967-4fb3-8519-ebad3469756a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096329 Jun 02 09:11:29.591711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 38/68] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:29.591711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:29.600709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:29.638055 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:29.638520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:29.639322 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:29.639895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:29.727639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:29.748065 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:29.752983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:29.761321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4069bcea-ce5c-4bbe-82b7-62a624ba3eee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1332 microversion: 2.20 time: 0.329854 Jun 02 09:11:29.763023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 31/69] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:29 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:30.228426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-b55317ca-a6ff-445a-ba5a-42e5f8b79b03 req-048a9558-5231-4fed-9930-481441cfe22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cfeba25-7463-4c2e-a76e-8fb2dfaae97d", "tag": "672e1526-26b2-4a56-8af6-7a2de997dc92"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:30.260584 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-b55317ca-a6ff-445a-ba5a-42e5f8b79b03 req-048a9558-5231-4fed-9930-481441cfe22f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.263886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-b55317ca-a6ff-445a-ba5a-42e5f8b79b03 req-048a9558-5231-4fed-9930-481441cfe22f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.313344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-b55317ca-a6ff-445a-ba5a-42e5f8b79b03 req-048a9558-5231-4fed-9930-481441cfe22f service nova] Creating event network-changed:672e1526-26b2-4a56-8af6-7a2de997dc92 for instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d on hv-cinder-82549 Jun 02 09:11:30.315567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-b55317ca-a6ff-445a-ba5a-42e5f8b79b03 req-048a9558-5231-4fed-9930-481441cfe22f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118037) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 09:11:30.317632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.318780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.320714 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.321612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.354760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.compute.rpcapi [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 09:11:30.358529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] Releasing lock "compute-rpcapi-router" {{(pid=118037) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 09:11:30.408617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:30.416224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e5d27341-e7ed-42aa-b2d8-eb6abc9528af None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.646411 Jun 02 09:11:30.420981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2f600b59-96a1-4366-a791-87b9808e5dd7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.841550 Jun 02 09:11:30.423573 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 39/70] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:29 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:30.432976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 32/71] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:30.447832 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:30.451779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:30.477900 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.493903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.493903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.493903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.497468 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:30.498130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:30.506780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.507226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.512760 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:30.512760 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:30.983408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:30.991318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-78a846c4-9f1d-4da9-a274-5b8484704aee tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.559921 Jun 02 09:11:30.991884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 33/72] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:30 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:31.007815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:31.008402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:31.015368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:31.015874 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:31.016666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:31.017164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:31.101310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:31.101949 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:31.111800 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e21f24b8-e680-4ac3-867b-48ad193da5a2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.626084 Jun 02 09:11:31.111974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:31.113546 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:31.115012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 40/73] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:30 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:31.116640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7286d446-da81-4db7-bfcb-8a5cd5df85d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1338 microversion: 2.20 time: 0.121878 Jun 02 09:11:31.117358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 34/74] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:30 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1338 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:31.458470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:31.459492 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:31.467167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:31.467803 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:31.474529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:31.474529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:31.633729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:31.651400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7cc7824d-5940-4de8-b828-a24b83a80060 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.208581 Jun 02 09:11:31.652866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 41/75] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:31 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:32.022953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:32.022953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:32.025465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.026505 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.027663 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.028859 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.131526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:32.132149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:32.140241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.140696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.141476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.141913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.189274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.207212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f395b990-af18-4fb5-922e-9ee71b8fecdd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.187022 Jun 02 09:11:32.207212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 35/76] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:32 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:32.207212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:32.207212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:32.210882 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.211429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.212320 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.212795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.497966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.506557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ad6cfb13-7731-40cb-a9c3-9868691d2b5a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.379334 Jun 02 09:11:32.507126 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 42/77] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:32 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:32.512985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-36d6cb76-1747-4c8d-bf53-3a6c98b9f57b req-6eea2418-fa09-4495-88a3-6eb5a58ab056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19073d8-fcec-4ea0-945a-c532266bf751", "tag": "cba0b34d-2285-4a05-b72a-0bc3109cf26f"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:32.521811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-36d6cb76-1747-4c8d-bf53-3a6c98b9f57b req-6eea2418-fa09-4495-88a3-6eb5a58ab056 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.522998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-36d6cb76-1747-4c8d-bf53-3a6c98b9f57b req-6eea2418-fa09-4495-88a3-6eb5a58ab056 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.537242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-36d6cb76-1747-4c8d-bf53-3a6c98b9f57b req-6eea2418-fa09-4495-88a3-6eb5a58ab056 service nova] Creating event network-changed:cba0b34d-2285-4a05-b72a-0bc3109cf26f for instance b19073d8-fcec-4ea0-945a-c532266bf751 on hv-cinder-82549 Jun 02 09:11:32.542488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-36d6cb76-1747-4c8d-bf53-3a6c98b9f57b req-6eea2418-fa09-4495-88a3-6eb5a58ab056 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033927 Jun 02 09:11:32.543730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 43/78] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:32.556046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.564594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.565646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.566867 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8e05d4a5-de27-4445-85ba-9352e82c3347 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.367674 Jun 02 09:11:32.579081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 36/79] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:32 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:32.669304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:32.670021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:32.677531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.678305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.679096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:32.679718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:32.834389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:32.843765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1e626d11-9c7e-4b2c-9e19-992e916adfb5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.178782 Jun 02 09:11:32.845100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 44/80] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:32 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:33.214986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:33.218368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:33.225713 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.227424 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.228516 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.229101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.416947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:33.432009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d485efb7-9c24-49b1-abdb-9bf0700c8cf6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.221152 Jun 02 09:11:33.434039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 37/81] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:33 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:33.531624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:33.537699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:33.541369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.541918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.542810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.543272 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.587026 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:33.589301 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:33.596495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.597140 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.598128 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.598803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.765890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:33.781382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-78c97431-e5d1-4c75-befa-35666624ae8e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.260769 Jun 02 09:11:33.782226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 45/82] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:33 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:33.863876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:33.865224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:33.867572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:33.880757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:33.882281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:33.885741 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.886641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-070e9246-fa66-4360-9664-c22c3b722852 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.301312 Jun 02 09:11:33.888191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.890054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:33.895198 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:33.899394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 38/83] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:33 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:34.145306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:34.154771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c7292bbe-19cc-4e20-8533-85f22830b2fa tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.294996 Jun 02 09:11:34.155452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 46/84] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:33 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:34.190309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-e113c409-2d22-42fc-981c-8214fcf12e32 req-b6600481-d6f6-4efe-ba7f-70051adee7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:34.194690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:34.199910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e113c409-2d22-42fc-981c-8214fcf12e32 req-b6600481-d6f6-4efe-ba7f-70051adee7a5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.200353 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e113c409-2d22-42fc-981c-8214fcf12e32 req-b6600481-d6f6-4efe-ba7f-70051adee7a5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.207001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=99 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:34.212040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-e113c409-2d22-42fc-981c-8214fcf12e32 req-b6600481-d6f6-4efe-ba7f-70051adee7a5 service nova] Creating event network-changed:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:11:34.222280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-e113c409-2d22-42fc-981c-8214fcf12e32 req-b6600481-d6f6-4efe-ba7f-70051adee7a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034659 Jun 02 09:11:34.227598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 39/85] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:34.451680 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:34.452487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:34.458862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=8 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:34.461433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.462113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.463017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.463570 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.656957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:34.665479 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0b833f8a-86ed-40b0-9365-345eb8b2f580 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.219021 Jun 02 09:11:34.666125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 47/86] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:34 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:34.798612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:34.799625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:34.807280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.807939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.809940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.810545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.948605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:34.948605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:34.948605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.948605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.949158 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:34.949158 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:34.981258 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:34.990504 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c8a3178e-bc85-4c38-a346-ba1d7e9ea10e tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.195932 Jun 02 09:11:34.991183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 40/87] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:34 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:35.091043 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:35.100171 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:35.101771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:35.102893 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5990d701-dbed-49cf-9161-15f7cabe668e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.200457 Jun 02 09:11:35.103495 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 48/88] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:34 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:35.171474 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:35.172171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:35.178452 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:35.179030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:35.179987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:35.180518 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:35.341296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:35.341296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03d3db26-0459-4df4-ac6d-17249155ea27 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.171256 Jun 02 09:11:35.341296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 41/89] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:35 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:35.682309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:35.682919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:35.689036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:35.689484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:35.690243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:35.690676 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:35.824481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:35.834122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8f1eeb6f-c5ca-470c-b18d-dd27ca09afa5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.155639 Jun 02 09:11:35.834703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 49/90] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:35 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:36.015262 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:36.016163 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:36.028697 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.029249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:36.030105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.030554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:36.085132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=22 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:36.122524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:36.123183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:36.133260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.134151 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:36.135219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.136039 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:36.769591 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:36.780456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-32f88456-d9b7-4a26-b1d7-00e369090e3a tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.770012 Jun 02 09:11:36.781030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 42/91] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:36 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:36.786060 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:36.787194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:36.796635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.796635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:36.796635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:36.796635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:37.087869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:37.099809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:37.102079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:37.103473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cb68d246-e67a-4b0d-8692-dd4793e0222c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.985146 Jun 02 09:11:37.104319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 50/92] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:36 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:37.111439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:37.112188 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:37.120058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:37.120917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:37.121963 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:37.122502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:37.553573 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:37.562781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-142b4005-d167-467d-8f48-141ff1eec3e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.780119 Jun 02 09:11:37.563492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 43/93] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:36 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:37.573837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:37.582746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a9574e72-20de-40ab-91f3-7ae72c38415c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.477357 Jun 02 09:11:37.584160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 51/94] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:37 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:37.804347 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:37.805544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:37.815547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:37.816002 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:37.829567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:37.829567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.074686 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.082351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-57b1718c-2d18-4bda-bd6a-e9ff83d6fffd tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.282037 Jun 02 09:11:38.085524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 44/95] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:37 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:38.134010 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:38.135265 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:38.143054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.147748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.147748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.147748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.295168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.317622 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.319092 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.320246 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0e0a770d-06dc-455b-b12b-34720ef0a3ef tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.197178 Jun 02 09:11:38.330692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 52/96] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:38 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:38.581625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:38.582280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:38.590911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.591405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.592194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.592635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.602954 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:38.604847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:38.616691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.617142 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.617927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:38.619417 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:38.936591 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.949681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8defb3c7-e436-428f-b609-d97790870352 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.372959 Jun 02 09:11:38.954316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:38.967828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e3ec4559-d577-4835-a376-9e417b5ce420 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.366920 Jun 02 09:11:38.967828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 53/97] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:38 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:38.967989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 45/98] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:38 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:39.111019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:39.112055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:39.119207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.119802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.120777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.121421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.151456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-3334006f-e45f-43ea-b9c4-029445fcd5a2 req-a61a20b8-9d20-403a-a65c-99f31111e10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cfeba25-7463-4c2e-a76e-8fb2dfaae97d", "name": "network-vif-plugged", "status": "completed", "tag": "672e1526-26b2-4a56-8af6-7a2de997dc92"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:39.161071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3334006f-e45f-43ea-b9c4-029445fcd5a2 req-a61a20b8-9d20-403a-a65c-99f31111e10a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.161522 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3334006f-e45f-43ea-b9c4-029445fcd5a2 req-a61a20b8-9d20-403a-a65c-99f31111e10a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.188602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-3334006f-e45f-43ea-b9c4-029445fcd5a2 req-a61a20b8-9d20-403a-a65c-99f31111e10a service nova] Creating event network-vif-plugged:672e1526-26b2-4a56-8af6-7a2de997dc92 for instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d on hv-cinder-82549 Jun 02 09:11:39.202413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-3334006f-e45f-43ea-b9c4-029445fcd5a2 req-a61a20b8-9d20-403a-a65c-99f31111e10a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176669 Jun 02 09:11:39.205719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 54/99] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:39.341967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:39.347592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:39.348512 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:39.352947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a017ea6f-ae1e-4b1e-89c6-fd95028739e8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.245617 Jun 02 09:11:39.353884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 46/100] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:39 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:39.368628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.369475 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.370532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.370933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.388213 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:39.579975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:39.595072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:39.598352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:39.600423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2b3da020-e2f4-4813-92ba-98ef325b05d4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.264979 Jun 02 09:11:39.610516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 55/101] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:39 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:39.968834 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:39.969451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:39.976128 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.976797 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.977849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:39.978466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:39.981554 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:39.982370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:40.001026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.001026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.001026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.001026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.189391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.197472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-332448a5-5247-4de5-b9dd-e436337ff824 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.232402 Jun 02 09:11:40.198052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 47/102] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:39 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:40.227076 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.234288 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-873df44e-9f9d-421f-bc19-c36c6b93396f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.257042 Jun 02 09:11:40.235015 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 56/103] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:39 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:40.371030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:40.371801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:40.373710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:40.378762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.379207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.381178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.381178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.523060 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.531096 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7c7e345e-adf7-4059-a49d-740642185ff6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.164424 Jun 02 09:11:40.531913 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 48/104] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:40 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:40.620220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:40.621240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:40.628192 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.628867 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.630194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:40.630695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:40.909289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.917749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.919257 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:40.920367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e895b3f8-4518-4844-8d28-fe39713f5b6a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.304382 Jun 02 09:11:40.920924 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 57/105] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:40 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:41.214983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:41.216758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:41.222220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-2d2e874a-116e-4754-ae9f-252c5069641e req-908d383e-8ffd-4309-96e5-36b162468d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f49ccd0-ef5e-4ead-8f24-4504c183a9cb", "name": "network-vif-plugged", "status": "completed", "tag": "036c52c3-66e8-4a2a-900c-787f3c21fa59"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:41.234828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2d2e874a-116e-4754-ae9f-252c5069641e req-908d383e-8ffd-4309-96e5-36b162468d90 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.235303 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2d2e874a-116e-4754-ae9f-252c5069641e req-908d383e-8ffd-4309-96e5-36b162468d90 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.237493 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.239539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.239539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.239539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.255872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-2d2e874a-116e-4754-ae9f-252c5069641e req-908d383e-8ffd-4309-96e5-36b162468d90 service nova] Creating event network-vif-plugged:036c52c3-66e8-4a2a-900c-787f3c21fa59 for instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb on hv-cinder-82549 Jun 02 09:11:41.261656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-2d2e874a-116e-4754-ae9f-252c5069641e req-908d383e-8ffd-4309-96e5-36b162468d90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042836 Jun 02 09:11:41.263293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 58/106] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:41.269873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:41.271127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:41.277747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.278389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.279340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.279969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.467283 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:41.483562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e0d86e08-50f2-4c2c-8ef2-00504fbeb608 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.272591 Jun 02 09:11:41.486005 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 49/107] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:41 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:41.504632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:41.512888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a2c95866-8568-459b-a9d1-aa5021d12823 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.248015 Jun 02 09:11:41.513777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 59/108] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:41 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:41.549032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:41.549991 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:41.559281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.559941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.560838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.561439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.733814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:41.741904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dcab109d-c714-4590-a951-887d680d568d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.196888 Jun 02 09:11:41.742751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 50/109] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:41 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:41.937628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:41.938244 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:41.944942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.945392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:41.946165 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:41.946599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.072567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.080656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.082081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.083831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7c69c760-c287-48f9-8296-de09ed1a64a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.149320 Jun 02 09:11:42.084391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 60/110] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:41 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:42.500650 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:42.501256 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:42.507207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.507732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.508486 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.508910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.529827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:42.530445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:42.536481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.537109 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.538371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.538809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.704949 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.713788 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6d205f8f-2bfd-4e70-8a4d-0944a1a0738c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.216824 Jun 02 09:11:42.714720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 51/111] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:42 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:42.717289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.728119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5ac2c4c4-6136-4005-9c69-16da192b37e2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.202021 Jun 02 09:11:42.728676 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 61/112] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:42 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:42.758831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:42.759485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:42.766047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.766632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.767509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:42.768021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:42.898592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:42.906130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f50feb81-f914-4383-be7e-37fa68fbfa7c tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.151782 Jun 02 09:11:42.906693 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 52/113] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:42 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:43.103432 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:43.104154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:43.110697 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.111311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:43.112163 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.112668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:43.257456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:43.265709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:43.267175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:43.268292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ded95953-7bbe-47f0-b87c-8e0e1ce9c883 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.169350 Jun 02 09:11:43.268841 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 62/114] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:43 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:43.730242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:43.730883 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:43.737171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.737651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:43.738498 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.738936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:43.748626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:43.748626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:43.753868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.754510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:43.755555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:43.756154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.028727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.036834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.045640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9da43664-4bd2-419f-a0c0-fa3e87192e19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.304046 Jun 02 09:11:44.047661 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9c95ddb8-8da1-4da4-a4bb-06c9dd7649c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.320961 Jun 02 09:11:44.051990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 53/115] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:43 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:44.057181 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-145be842-199e-4876-b35a-2af5cdb10a17 req-bf36789e-2e66-47f2-a25a-f2e7e964b431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19073d8-fcec-4ea0-945a-c532266bf751", "name": "network-vif-plugged", "status": "completed", "tag": "cba0b34d-2285-4a05-b72a-0bc3109cf26f"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:44.063375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 63/116] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:43 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:44.071164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-145be842-199e-4876-b35a-2af5cdb10a17 req-bf36789e-2e66-47f2-a25a-f2e7e964b431 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:44.071969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-145be842-199e-4876-b35a-2af5cdb10a17 req-bf36789e-2e66-47f2-a25a-f2e7e964b431 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.073993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:44.075041 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:44.088696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:44.091150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.091280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-145be842-199e-4876-b35a-2af5cdb10a17 req-bf36789e-2e66-47f2-a25a-f2e7e964b431 service nova] Creating event network-vif-plugged:cba0b34d-2285-4a05-b72a-0bc3109cf26f for instance b19073d8-fcec-4ea0-945a-c532266bf751 on hv-cinder-82549 Jun 02 09:11:44.091381 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:44.091381 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.097644 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-145be842-199e-4876-b35a-2af5cdb10a17 req-bf36789e-2e66-47f2-a25a-f2e7e964b431 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042619 Jun 02 09:11:44.098166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 54/117] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:44.228153 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.235975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a679e490-c53a-4317-83fd-ccb4f63c58ff tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.171224 Jun 02 09:11:44.245043 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 64/118] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:44 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:44.289080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:44.290426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:44.300027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:44.300514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.301296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:44.303995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:44.445080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.458492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.460175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:44.461297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bc706359-b0ab-41bb-9c71-9fe34e80924e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.178896 Jun 02 09:11:44.464243 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 55/119] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:44 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:45.061874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:45.063190 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:45.075191 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:45.076079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.076607 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.076941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:45.077542 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.078054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.087989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.089645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.090854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.105761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.365526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.381387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.381992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b291fe56-2b7c-4b5c-90a2-afdb33e95057 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.318342 Jun 02 09:11:45.383298 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 65/120] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:45 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:45.390140 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-59711b75-63b1-46e1-901a-4a971d88fae4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.320679 Jun 02 09:11:45.391524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 56/121] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:45 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:45.392916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:45.395678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:45.414579 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.415115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.416139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.416631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.481830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:45.482659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:45.489710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.494666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.494666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:45.494666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:45.496242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=100 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:45.627092 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.635461 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d7866ca6-4a5f-4e79-a699-d7171b353d38 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.249471 Jun 02 09:11:45.635961 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 66/122] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:45 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:45.671213 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.679071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.681971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:45.684883 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f0763ef1-f20d-4034-8ceb-a3306c3c496c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.207507 Jun 02 09:11:45.687032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 57/123] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:45 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:46.113944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-3b2e2686-893c-4792-8233-fdd0aa559610 req-2c7f3851-7772-44c5-acda-97e9b54a27c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c0064-b00b-4cd5-8a5a-879b9c2b20a3", "name": "network-vif-plugged", "status": "completed", "tag": "1ade0213-9d25-4fe3-9205-a852bd57287c"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:46.123277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3b2e2686-893c-4792-8233-fdd0aa559610 req-2c7f3851-7772-44c5-acda-97e9b54a27c0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.123772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3b2e2686-893c-4792-8233-fdd0aa559610 req-2c7f3851-7772-44c5-acda-97e9b54a27c0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.143598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-3b2e2686-893c-4792-8233-fdd0aa559610 req-2c7f3851-7772-44c5-acda-97e9b54a27c0 service nova] Creating event network-vif-plugged:1ade0213-9d25-4fe3-9205-a852bd57287c for instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 on hv-cinder-82549 Jun 02 09:11:46.143598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-3b2e2686-893c-4792-8233-fdd0aa559610 req-2c7f3851-7772-44c5-acda-97e9b54a27c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032154 Jun 02 09:11:46.143598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 67/124] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:46.412668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:46.413285 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:46.415048 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:46.415853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:46.420040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.420487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.421286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.422379 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.423135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.423782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.424632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.425194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.853906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:46.854483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:46.862497 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8a7f149a-96e4-426c-8295-715f1374f44e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.454100 Jun 02 09:11:46.863601 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 58/125] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:46 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:46.864454 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4ce7a3b9-78c0-4d45-b7d0-33c845ea3e6b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.454248 Jun 02 09:11:46.865497 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 68/126] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:46 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:46.868866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:46.870289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:46.871659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:46.872419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:46.877428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.878062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.879192 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.879801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.880401 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.880969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:46.888490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:46.888490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:47.151976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:47.155395 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:47.170547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:47.172015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-435b5ea7-c1fe-4ae9-b0f2-af75a546d588 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.307190 Jun 02 09:11:47.172174 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:47.172597 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 59/127] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:46 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:47.173258 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9ff098e4-3304-4971-874e-fab30ee5d6f6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.306698 Jun 02 09:11:47.173795 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 69/128] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:46 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:47.884840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:47.885383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:47.887623 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:47.889332 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:47.897700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:47.898441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:47.899530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:47.899880 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:47.900296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:47.901097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:47.903784 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:47.904440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:48.126164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.132005 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.135839 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4d9e8918-129d-4a6b-8305-ff1f3ec8336f tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.255372 Jun 02 09:11:48.136729 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 60/129] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:47 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:48.142233 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dc7559fc-3db7-40d6-861d-200600d58619 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.261285 Jun 02 09:11:48.142799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 70/130] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:47 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:48.192565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:48.194063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:48.201579 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:48.203223 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:48.224775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:48.224775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:48.224775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:48.225137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:48.229220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:48.230071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:48.238850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:48.238850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:48.501638 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.510726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.511003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1dfbab75-2e82-4ee5-b7a4-5cc8a728045f tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1315 microversion: 2.1 time: 0.325252 Jun 02 09:11:48.511586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 61/131] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:48 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:48.520038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.521892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:48.523022 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-28a5bf7d-8741-4b40-bc4a-19335a7b667b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.334938 Jun 02 09:11:48.523795 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 71/132] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:48 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:49.069468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-42b44a82-4766-4741-8399-1ae662fd8712 req-43b8a520-fc54-4491-9036-fedb1ff5349e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "name": "network-vif-plugged", "status": "completed", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:49.078350 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-42b44a82-4766-4741-8399-1ae662fd8712 req-43b8a520-fc54-4491-9036-fedb1ff5349e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.078992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-42b44a82-4766-4741-8399-1ae662fd8712 req-43b8a520-fc54-4491-9036-fedb1ff5349e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.092628 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-42b44a82-4766-4741-8399-1ae662fd8712 req-43b8a520-fc54-4491-9036-fedb1ff5349e service nova] Creating event network-vif-plugged:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:11:49.098473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-42b44a82-4766-4741-8399-1ae662fd8712 req-43b8a520-fc54-4491-9036-fedb1ff5349e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 Jun 02 09:11:49.099106 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 62/133] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:49.154226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:49.154226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:49.161446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:49.167444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:49.168976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.171169 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.173394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.174864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.176560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.178282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.179567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.180604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.437048 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.443430 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.447922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-610578f6-1c77-4a1b-8bb8-e6939815e4a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.298358 Jun 02 09:11:49.459116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 72/134] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:49 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:49.461300 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-709df3ba-8fb5-4b76-920b-0fbbbdb77f49 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.304670 Jun 02 09:11:49.461957 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 63/135] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:49 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:49.527797 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:49.528403 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:49.536140 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.536582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.537932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.541248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.542899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:49.543538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:49.550204 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.550807 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.551719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:49.552231 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:49.554952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:49.815922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.827138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2c511acf-ad66-4d71-9b02-980b2f3fdee3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1503 microversion: 2.1 time: 0.302386 Jun 02 09:11:49.828397 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 73/136] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:49 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:49.923509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.934825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.934825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:49.944100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0ab846a7-fb8f-41c7-bd50-f1033a31608f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.404717 Jun 02 09:11:49.945422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 64/137] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:49 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:50.465565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:50.466347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:50.473124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.473848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:50.474901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.475582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:50.481173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:50.482495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:50.492048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.492645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:50.493617 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.494058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:50.680336 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:50.689154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8eada53d-3591-4594-a231-f29b8eedd20a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1364 microversion: 2.1 time: 0.228479 Jun 02 09:11:50.690015 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 74/138] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:50 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:50.706549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:50.715362 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b173d790-d772-4420-92ab-7881544c3759 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1321 microversion: 2.1 time: 0.241089 Jun 02 09:11:50.730981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 65/139] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:50 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:50.965647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:50.966281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:50.968739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=97 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:50.973999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.974986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:50.976478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:50.976478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.119452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:51.127465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:51.128978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:51.130081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-df56282b-fb75-44ac-9924-ff9f81b3b531 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.170079 Jun 02 09:11:51.130640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 75/140] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:50 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:51.706551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:51.707441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:51.713770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.715009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.715009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.715435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.732238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:51.732882 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:51.738935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.739424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.740780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.741229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.937749 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:51.941032 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:51.947130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-64eaa425-f7b1-4492-99ac-dc784de56271 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1551 microversion: 2.1 time: 0.245103 Jun 02 09:11:51.947796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 66/141] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:51 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1551 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:51.955333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7222c2ff-ec0d-4685-97d6-b02de38789e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1515 microversion: 2.1 time: 0.220776 Jun 02 09:11:51.955333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 76/142] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:51 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:51.966224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:51.966684 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:51.967168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:51.967611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:51.973382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.973827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.975021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.975172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.975656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.975777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:51.976548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:51.977044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:52.036645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'flavor' on Instance uuid 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:11:52.109572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ae271581-95ad-4f05-82b2-be0a244ec4cd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147393 Jun 02 09:11:52.110179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 77/143] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:11:51 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:52.149705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:52.150395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:52.156427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:52.156867 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:52.157658 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:52.158085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:52.342249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4c5354cd-8403-49b8-b577-89aef8e0d0e5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3/action" status: 200 len: 32 microversion: 2.1 time: 0.379860 Jun 02 09:11:52.342872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 67/144] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:11:51 2022] POST /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:11:52.352386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:52.353094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:52.356575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:52.360224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:52.362311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:52.363431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:52.364033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:52.367039 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:52.369104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:52.370640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-61723409-f901-4302-ad0f-ee527793aecc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.225326 Jun 02 09:11:52.371314 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 78/145] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:52 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:52.527140 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:52.534771 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5d5832d7-476c-49fa-a231-9244413965de tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.186621 Jun 02 09:11:52.535386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 68/146] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:52 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:53.331655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fdc3fcb-c1f1-45f9-9dba-304bf0207649"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:53.334404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:53.348229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.348678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.350149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.350890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.388828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:53.390193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:53.398519 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.399138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.400200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.401314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.633757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:53.659772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:53.661357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:53.663181 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-992b803b-a3b5-463b-9323-0804078ad5e6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1405 microversion: 2.20 time: 0.278308 Jun 02 09:11:53.663811 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 69/147] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:53 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:11:53.671984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:53.672659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:53.679688 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.680134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.680902 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.681329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.819675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:53.827589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-efd0d5d4-2f54-45e3-a0c9-c6705009d722 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.162727 Jun 02 09:11:53.828529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 70/148] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:53 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:53.833667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-e098e4ef-b6e0-4979-936f-ffa325cabf88 req-80bf3521-1939-4647-8e37-b91db87dd2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b19073d8-fcec-4ea0-945a-c532266bf751", "tag": "cba0b34d-2285-4a05-b72a-0bc3109cf26f"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:53.842619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e098e4ef-b6e0-4979-936f-ffa325cabf88 req-80bf3521-1939-4647-8e37-b91db87dd2f0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:53.843090 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e098e4ef-b6e0-4979-936f-ffa325cabf88 req-80bf3521-1939-4647-8e37-b91db87dd2f0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:53.854269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-e098e4ef-b6e0-4979-936f-ffa325cabf88 req-80bf3521-1939-4647-8e37-b91db87dd2f0 service nova] Creating event network-changed:cba0b34d-2285-4a05-b72a-0bc3109cf26f for instance b19073d8-fcec-4ea0-945a-c532266bf751 on hv-cinder-82549 Jun 02 09:11:53.859033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-e098e4ef-b6e0-4979-936f-ffa325cabf88 req-80bf3521-1939-4647-8e37-b91db87dd2f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029324 Jun 02 09:11:53.859773 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 71/149] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:54.681733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:54.682425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:54.688703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:54.689137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:54.689898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:54.690330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:54.827077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:54.834976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:54.836558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:54.837824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d16debd3-f04a-4fb0-b2dc-36a73b9cd797 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1597 microversion: 2.20 time: 0.160471 Jun 02 09:11:54.838373 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 72/150] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:11:54 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:11:54.845285 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:54.845907 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:54.851941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:54.852381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:54.853141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:54.853569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:54.857588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:11:54.984733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:54.992625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f83ed328-60fc-408d-9206-e219e168f5df tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.150854 Jun 02 09:11:54.993187 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 73/151] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:54 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:54.997608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:54.998094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:55.003662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:55.004109 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:55.004865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:55.005298 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:55.085302 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-85845460-24e4-4f9a-a78b-38afba9d3986 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091052 Jun 02 09:11:55.085893 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 74/152] 10.222.0.18 () {60 vars in 1315 bytes} [Thu Jun 2 09:11:54 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:11:56.010127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:56.010733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:56.017081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:56.017528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:56.018327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:56.018757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:56.224863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:56.232317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-373be53b-fa6b-4dd9-92f5-10b4ae9b4bce tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.226510 Jun 02 09:11:56.233083 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 75/153] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:56 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:56.520758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-8e2ff515-4ae6-4b8d-81c7-38f4e5b70850 req-f5cf16f2-5eb7-45c4-bd06-aff80d6b4fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:11:56.529838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8e2ff515-4ae6-4b8d-81c7-38f4e5b70850 req-f5cf16f2-5eb7-45c4-bd06-aff80d6b4fa4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:56.530286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8e2ff515-4ae6-4b8d-81c7-38f4e5b70850 req-f5cf16f2-5eb7-45c4-bd06-aff80d6b4fa4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:56.544077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-8e2ff515-4ae6-4b8d-81c7-38f4e5b70850 req-f5cf16f2-5eb7-45c4-bd06-aff80d6b4fa4 service nova] Creating event network-changed:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:11:56.549760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-8e2ff515-4ae6-4b8d-81c7-38f4e5b70850 req-f5cf16f2-5eb7-45c4-bd06-aff80d6b4fa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032433 Jun 02 09:11:56.550695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 76/154] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:11:57.253487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:57.255441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:57.267268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:57.268886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:57.269422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:57.269908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:57.616288 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:57.624304 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-254f71d3-87b6-4014-8038-ca12dde9a0d5 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.377867 Jun 02 09:11:57.624918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 77/155] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:57 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:11:57.954384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b687fb35-6e4d-4f92-b0de-72097ea04bc2 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "POST /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.632875 Jun 02 09:11:57.955061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 79/156] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:11:53 2022] POST /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb/os-volume_attachments => generated 194 bytes in 4635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:11:58.642406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:58.642845 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:58.649365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:58.649815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:58.650592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:58.651054 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:58.788889 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:58.797102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4539f050-3094-4e45-b563-429c10b404fe tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.159271 Jun 02 09:11:58.797675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 78/157] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:58 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:11:59.821292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:11:59.821985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:11:59.828731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:59.829190 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:59.829944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:11:59.830379 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:11:59.964319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:11:59.972902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-871c396b-b8bc-4408-9ea2-47f9ae72d935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.156035 Jun 02 09:11:59.982274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 80/158] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:11:59 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:00.989547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:00.990160 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:00.996193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:00.996631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:00.997380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:00.997805 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:01.124787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:01.133107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b9201741-c699-42b8-9363-f5ba93770ea1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.147284 Jun 02 09:12:01.133741 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 79/159] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:00 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:02.150066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:02.150639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:02.156970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:02.157423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:02.158220 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:02.158665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:02.394078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:02.402256 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6fb1f18c-837b-4f35-b465-8edb8ecb5956 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.256074 Jun 02 09:12:02.403473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 81/160] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:02 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:03.420727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:03.420727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:03.428011 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:03.428814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:03.429873 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:03.430643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:03.601549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:03.610205 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-255db30a-52b8-4ab5-aeb7-3a13d5a2095d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.194533 Jun 02 09:12:03.610767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 80/161] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:03 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:04.628523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:04.629596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:04.636548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:04.637151 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:04.638286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:04.638799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:04.791290 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:04.801864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7690275c-cc40-4e4e-aa28-c2c51951172c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.177604 Jun 02 09:12:04.811639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 82/162] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:04 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:05.818111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:05.818719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:05.825394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:05.825847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:05.826619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:05.827048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:05.972804 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:05.980955 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-65ece525-649c-4021-8c67-46359d99db58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.166822 Jun 02 09:12:05.981514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 81/163] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:05 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:06.997717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:06.998359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:07.004877 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:07.005364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:07.006129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:07.006559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:07.166107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:07.174777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cfe9edfc-882e-45cb-ba2f-72b56f623735 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.180949 Jun 02 09:12:07.175408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 83/164] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:06 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:08.191352 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:08.191961 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:08.199857 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=86 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:08.205135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:08.205585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:08.206358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:08.206879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:08.357271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:08.367529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03e66c5b-9c96-4255-991c-b99bc7241766 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.180112 Jun 02 09:12:08.379625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 82/165] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:08 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:09.385374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:09.385990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:09.392994 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:09.395824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:09.395824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:09.395824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:09.552999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:09.562631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-18daa66e-236f-4608-ab63-18041a234b5b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.181624 Jun 02 09:12:09.563730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 84/166] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:09 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:10.237240 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:10.237968 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:10.244833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.245585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.246408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.246869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.271847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:12:10.580508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:10.581118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:10.586233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cf0ed6a5-e3d2-48c6-93ff-c31b88c19a31 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 204 len: 0 microversion: 2.1 time: 0.352536 Jun 02 09:12:10.587022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 83/167] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:12:10 2022] DELETE /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:12:10.591507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.593457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.593735 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.594466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.595478 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:10.596177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:10.604180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.604631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.605405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:10.605910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:10.789114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:10.796894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-33a258e3-5696-42d7-b5ef-439f1b94a3be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.220121 Jun 02 09:12:10.797675 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 85/168] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:10 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:10.804857 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:10.813295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0d424696-ec3e-420e-8cc4-7049b6d308ec tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.222047 Jun 02 09:12:10.813865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 84/169] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:10 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:11.813898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:11.814513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:11.821020 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:11.821472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:11.822239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:11.822713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:11.830041 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:11.830864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:11.843105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:11.843105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:11.843105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:11.843105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:12.061779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:12.065160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:12.070311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3428ea26-8e2e-4bde-bfea-39218b08c0b3 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.244083 Jun 02 09:12:12.071033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:11 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:12.078374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-895e2334-8b33-4161-ae0d-5352a6a48399 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.263851 Jun 02 09:12:12.078374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 86/171] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:11 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:13.087956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:13.088561 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:13.090324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:13.090947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:13.094894 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:13.095383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:13.096231 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:13.096786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:13.097808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:13.098309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:13.102544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:13.102544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:13.297825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:13.303980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:13.320831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4cda55df-c08e-409d-8186-ab5c32f23376 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.223758 Jun 02 09:12:13.320831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 86/172] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:13 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:13.321003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-294293ba-0254-4cd5-b408-fcf8878961b0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.226858 Jun 02 09:12:13.321003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 87/173] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:13 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:14.327788 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:14.328392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:14.329506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:14.330142 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:14.334495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:14.334942 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:14.335733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:14.336168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:14.336478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:14.336917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:14.337670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:14.338104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:14.527606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:14.535064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:14.535512 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-01014e11-e07b-44a4-83e5-f6d4cf5d3270 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.211607 Jun 02 09:12:14.536086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 87/174] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:14 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:14.543739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b778ca6b-150f-4c27-97b6-05038ccbf470 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.217923 Jun 02 09:12:14.544431 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:14 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:15.503656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1868552632", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "networks": [{"uuid": "6fdaaf9d-a64b-40f4-abb6-cbdf593b2ddc"}]}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:15.552095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:15.552704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:15.558503 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] validate_networks() for [('6fdaaf9d-a64b-40f4-abb6-cbdf593b2ddc', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:12:15.559781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:15.560229 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:15.561001 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:15.561432 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:15.564256 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:15.765743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:15.774864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6ae41c0e-43e3-4612-b9bb-3d579129ae9b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.226481 Jun 02 09:12:15.775777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 89/176] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:15 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:15.781243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:15.782066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:15.788563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:15.789010 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:15.790210 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:15.791101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:16.015312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:16.022793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4dc682b7-c485-4610-a566-c4df02a88aa0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.245812 Jun 02 09:12:16.023378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 90/177] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:15 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:16.053585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:12:16.054601 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:12:16.055476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:12:16.056226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:12:16.057027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:12:16.066940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:16.067419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:16.068279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:16.069421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:16.087367 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Getting quotas for project f835785be0684dc7a270a89a093e9609. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:12:16.091388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Getting quotas for user 75b429eb57bd41baaa1a0952ca63eeab and project f835785be0684dc7a270a89a093e9609. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:12:16.103082 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:12:16.105393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:12:16.214735 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d1206c79-00e1-41b0-bade-03a23c312a05 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715774 Jun 02 09:12:16.215408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 88/178] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:12:16.225160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d364b265-e05f-41b4-8a85-6698ae47a249 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:16.225765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d364b265-e05f-41b4-8a85-6698ae47a249 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:16.283525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d364b265-e05f-41b4-8a85-6698ae47a249 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:16.291130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d364b265-e05f-41b4-8a85-6698ae47a249 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1214 microversion: 2.1 time: 0.069633 Jun 02 09:12:16.291747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 91/179] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:16 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:16.794662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:16.795369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:16.801516 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:16.801962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:16.802727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:16.803157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:16.994356 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:16.996690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:17.002963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b5b2436d-e1e5-4bca-80db-803bd576eb7b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.212173 Jun 02 09:12:17.003544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 89/180] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:16 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:17.039648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:17.040265 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:17.046785 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:17.047473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:17.048345 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:17.048786 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:17.192155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:17.200305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3d2df930-14b1-4f51-b687-4872c09665d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.164798 Jun 02 09:12:17.200875 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 92/181] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:17 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:17.308371 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:17.309402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:17.316108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:17.316557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:17.317360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:17.317791 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:17.379199 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:17.387257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-47970988-cca2-4933-a2a3-d3b1e274950c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1218 microversion: 2.1 time: 0.083325 Jun 02 09:12:17.397000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 90/182] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:17 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:18.019467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:18.020079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:18.026484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.029626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.029626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.029626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.178407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:18.186989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4b5553f0-9788-472a-9c07-ec9e5432a721 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.171304 Jun 02 09:12:18.191630 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 93/183] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:18 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:18.217024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:18.217624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:18.224550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.225001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.226453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.227219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.361301 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:18.369094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-be0ed94b-ddfc-460b-92a4-9e99d79f226e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.156152 Jun 02 09:12:18.369713 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 91/184] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:18 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:18.403956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:18.404578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:18.410503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.410948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.411740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:18.412190 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:18.476465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:18.483919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-49953fca-8ab1-4b98-8e99-9d228560f686 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1210 microversion: 2.1 time: 0.083717 Jun 02 09:12:18.484489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 94/185] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:18 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:19.204462 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:19.205184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:19.212141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.212585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.218877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.218877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.356109 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:19.364177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b069b76d-d127-4351-8aef-c8f54867ae8d tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1555 microversion: 2.1 time: 0.163669 Jun 02 09:12:19.364824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:19 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:19.385992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:19.386604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:19.393272 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.393719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.394481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.394912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.522447 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:19.522447 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:19.533188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.533634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.534414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:19.534844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:19.664101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:19.680812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-01f6835b-3814-40f6-9301-e6bdb1f9f6e0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1266 microversion: 2.1 time: 0.179646 Jun 02 09:12:19.682271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 93/187] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:19 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:19.700542 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:19.709761 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9e011025-d81b-4583-8b11-941efee65fdf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.326530 Jun 02 09:12:19.710242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:19 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:20.337032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-a54123b9-b492-488d-8fc6-86e23c0627b4 req-c26ad0e2-3eda-4e1f-be51-23674450ddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f49ccd0-ef5e-4ead-8f24-4504c183a9cb", "name": "network-vif-deleted", "tag": "036c52c3-66e8-4a2a-900c-787f3c21fa59"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:20.346323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-a54123b9-b492-488d-8fc6-86e23c0627b4 req-c26ad0e2-3eda-4e1f-be51-23674450ddc3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.347107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-a54123b9-b492-488d-8fc6-86e23c0627b4 req-c26ad0e2-3eda-4e1f-be51-23674450ddc3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.360941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-a54123b9-b492-488d-8fc6-86e23c0627b4 req-c26ad0e2-3eda-4e1f-be51-23674450ddc3 service nova] Creating event network-vif-deleted:036c52c3-66e8-4a2a-900c-787f3c21fa59 for instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb on hv-cinder-82549 Jun 02 09:12:20.366329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-a54123b9-b492-488d-8fc6-86e23c0627b4 req-c26ad0e2-3eda-4e1f-be51-23674450ddc3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 Jun 02 09:12:20.366933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 94/189] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:20.381621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:20.382360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:20.389172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.389817 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.391212 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.391884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.648369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:20.657334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-06cadbca-c6e1-4d1f-90cb-981afddcb70b tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1513 microversion: 2.1 time: 0.279501 Jun 02 09:12:20.663647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 96/190] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:20 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:20.698773 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:20.699664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:20.706336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.707156 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.708046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.708814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.729492 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:20.730439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:20.738518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.739088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.739978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:20.740621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:20.794430 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:20.802058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0a6c6297-b209-4713-88f0-35533516aa1f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1272 microversion: 2.1 time: 0.107955 Jun 02 09:12:20.802654 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 95/191] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:20 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:20.986881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:20.995135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9305d156-191b-4cd3-81d4-434ddeb81e4f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.272949 Jun 02 09:12:20.995747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 97/192] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:20 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:21.674520 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:21.675117 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:21.681759 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:21.682215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:21.682982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:21.683457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:21.712787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:21.713234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:21.713685 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lazy-loading 'fault' on Instance uuid 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:12:21.792987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c99330cccfea41abbb7bc5b34956c612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '088ecec3bdbf404fa8474235018235ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:21.801298 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1b4685c1-c351-4f5b-bcde-8d8bf3a8d1d8 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 200 len: 1351 microversion: 2.1 time: 0.130603 Jun 02 09:12:21.802068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 96/193] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:21 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 1351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:21.825944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:21.826553 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:21.828860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=48 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:21.833900 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:21.834359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:21.835711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:21.836152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.007046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:22.009441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0d2110f4-18e1-487b-9a36-81ca80cae85b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.187406 Jun 02 09:12:22.010020 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 98/194] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:21 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:22.012009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:22.013033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:22.021960 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.022986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.024011 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.024454 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.231548 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:22.251907 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c5ef3724-3dce-44df-a666-f758718fd447 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.234100 Jun 02 09:12:22.252478 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 97/195] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:22 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:22.619861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-72b625a3-7caf-4607-837c-cb2cc66a1508 req-79095cec-b5ea-46a2-bbd5-24c13488e9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b36e287-3afe-4307-b0ae-b20d9b8ff5f2", "tag": "3bf89d97-fde9-4063-becd-7aff4a5bcc5f"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:22.627904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-72b625a3-7caf-4607-837c-cb2cc66a1508 req-79095cec-b5ea-46a2-bbd5-24c13488e9db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.628345 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-72b625a3-7caf-4607-837c-cb2cc66a1508 req-79095cec-b5ea-46a2-bbd5-24c13488e9db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.639543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-72b625a3-7caf-4607-837c-cb2cc66a1508 req-79095cec-b5ea-46a2-bbd5-24c13488e9db service nova] Creating event network-changed:3bf89d97-fde9-4063-becd-7aff4a5bcc5f for instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 on hv-cinder-82549 Jun 02 09:12:22.644678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-72b625a3-7caf-4607-837c-cb2cc66a1508 req-79095cec-b5ea-46a2-bbd5-24c13488e9db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028510 Jun 02 09:12:22.645268 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 99/196] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:22.817830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:22.818689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:22.825162 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.825605 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.826504 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.826962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.840604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] HTTP exception thrown: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Request method failure captured: Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb HTTP/1.1 Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6lc-UYk4SQQvZxTrNGkJooPY4zAFnebTPyTcQ2xzHaNKIXY8-Vuh3b7gPGZ78_VGfQ20cl_dNiTapqmqVijiSXnGzycz_8KAlulDnA9Q5p3HCGGq3nKgh8nR-p5macC9KvSF813QD05Pz8nm-wJxENMj_IzMOQRwwh4tuIMX6SOmU Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:12:22.845448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_088ecec3bdbf404fa8474235018235ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: c99330cccfea41abbb7bc5b34956c612 Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:22.846864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '5f49ccd0-ef5e-4ead-8f24-4504c183a9cb'} Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:22.847615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:22.848970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:22.849967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Returning 404 to user: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:22.849967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-fca589d5-8d74-4e31-90da-785460a03326 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 404 len: 111 microversion: 2.1 time: 0.032884 Jun 02 09:12:22.851784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 98/197] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:22 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:12:22.985123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:22.986204 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:22.992468 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.992918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:22.993716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:22.994155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:23.006558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] HTTP exception thrown: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Request method failure captured: Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb/os-volume_attachments HTTP/1.1 Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6lc-UYk4SQQvZxTrNGkJooPY4zAFnebTPyTcQ2xzHaNKIXY8-Vuh3b7gPGZ78_VGfQ20cl_dNiTapqmqVijiSXnGzycz_8KAlulDnA9Q5p3HCGGq3nKgh8nR-p5macC9KvSF813QD05Pz8nm-wJxENMj_IzMOQRwwh4tuIMX6SOmU Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:12:23.011321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_088ecec3bdbf404fa8474235018235ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: c99330cccfea41abbb7bc5b34956c612 Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:23.012990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'server_id': '5f49ccd0-ef5e-4ead-8f24-4504c183a9cb'} Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:23.013799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:23.015103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:23.016436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Returning 404 to user: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:23.016436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-168e83f4-1c72-4085-9023-00a2d4a9b4ed tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032666 Jun 02 09:12:23.016436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 100/198] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:12:22 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:12:23.026360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:23.031746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:23.038768 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:23.039441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:23.040128 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:23.040590 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:23.198703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:23.206162 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-59c50360-8e28-47d5-8a23-a9b727a53261 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.184357 Jun 02 09:12:23.206721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 99/199] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:23 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:23.260156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:23.260701 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:23.266953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:23.267436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:23.268209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:23.268648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:23.401443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:23.409419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-16125ca7-226a-4e8e-8137-b1a742833786 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.154042 Jun 02 09:12:23.409986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 101/200] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:23 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:24.223385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:24.223986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:24.230878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:24.231442 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:24.232308 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:24.232740 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:24.430979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:24.431861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:24.438154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:24.438749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:24.443909 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:24.443909 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:24.463805 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:24.473872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d0fb5b6c-c156-4c10-8528-c4c3f0f0dc18 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.254120 Jun 02 09:12:24.474982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 100/201] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:24 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:24.592733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:24.600406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5c2d807d-4977-4444-9cec-c7d0d075f49e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.174192 Jun 02 09:12:24.601444 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 102/202] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:24 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:25.491050 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:25.491601 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:25.498110 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.498550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.499338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.499773 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.526540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:25.527099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:25.533712 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.534164 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.534936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.535408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.549276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] HTTP exception thrown: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Request method failure captured: Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb HTTP/1.1 Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6lc-UYk4SQQvZxTrNGkJooPY4zAFnebTPyTcQ2xzHaNKIXY8-Vuh3b7gPGZ78_VGfQ20cl_dNiTapqmqVijiSXnGzycz_8KAlulDnA9Q5p3HCGGq3nKgh8nR-p5macC9KvSF813QD05Pz8nm-wJxENMj_IzMOQRwwh4tuIMX6SOmU Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:12:25.551631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_088ecec3bdbf404fa8474235018235ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: c99330cccfea41abbb7bc5b34956c612 Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.555138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '5f49ccd0-ef5e-4ead-8f24-4504c183a9cb'} Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:25.555822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.556849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.557902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Returning 404 to user: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:25.557902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dc8417f7-166e-4e0b-b9e7-41b0dc37e829 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jun 02 09:12:25.559013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 103/203] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:12:25 2022] DELETE /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:12:25.566843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:25.567482 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] [instance: 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:25.574668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.575122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.575985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.576427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.589942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] HTTP exception thrown: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Request method failure captured: Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb HTTP/1.1 Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6lc-UYk4SQQvZxTrNGkJooPY4zAFnebTPyTcQ2xzHaNKIXY8-Vuh3b7gPGZ78_VGfQ20cl_dNiTapqmqVijiSXnGzycz_8KAlulDnA9Q5p3HCGGq3nKgh8nR-p5macC9KvSF813QD05Pz8nm-wJxENMj_IzMOQRwwh4tuIMX6SOmU Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:12:25.591615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/088ecec3bdbf404fa8474235018235ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_088ecec3bdbf404fa8474235018235ca", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 088ecec3bdbf404fa8474235018235ca Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-DeleteServersTestJSON-1916384091 Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: c99330cccfea41abbb7bc5b34956c612 Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-DeleteServersTestJSON-1916384091-project Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.600657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '5f49ccd0-ef5e-4ead-8f24-4504c183a9cb'} Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:25.601450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. Jun 02 09:12:25.602567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:25.603962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] Returning 404 to user: Instance 5f49ccd0-ef5e-4ead-8f24-4504c183a9cb could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:25.603962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-de319ead-83fb-4eeb-a0df-1cc52c12c1a6 tempest-DeleteServersTestJSON-1916384091 tempest-DeleteServersTestJSON-1916384091-project] 10.222.0.18 "GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb" status: 404 len: 111 microversion: 2.1 time: 0.029944 Jun 02 09:12:25.603962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 104/204] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:25 2022] GET /compute/v2.1/servers/5f49ccd0-ef5e-4ead-8f24-4504c183a9cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:12:25.618373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:25.619152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:25.625216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.625765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.626610 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:25.627121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:25.638871 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:25.646703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e9c385bd-f941-4bcb-b943-ea69804ae35a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.159538 Jun 02 09:12:25.647917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 101/205] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:25 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:25.763899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:25.771518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5e59a380-c5d5-4cb9-a131-27f833edbe50 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.157592 Jun 02 09:12:25.772075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 105/206] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:25 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:26.665459 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:26.666514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:26.668817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:26.669475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:26.674567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:26.675251 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:26.676206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:26.676638 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:26.788883 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:26.789576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:26.791497 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:26.796780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:26.797224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:26.797988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:26.798441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:26.955846 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:26.970265 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5f0f219a-a8d7-49c7-a491-e7dab365b51d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.310255 Jun 02 09:12:26.980583 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 102/207] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:26 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:27.005115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:27.012928 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c17ad069-9ebf-4e34-abf0-fa98df65f7d8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.228223 Jun 02 09:12:27.013487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 106/208] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:26 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:27.987767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:27.988365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:27.995026 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:27.995507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:27.996266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:27.996694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:28.029989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:28.030758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:28.061219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:28.061819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:28.062543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:28.063165 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:28.229218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:28.238252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3322a802-82c6-468d-a4f5-0153926579d4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.254316 Jun 02 09:12:28.239134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 103/209] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:27 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:28.259036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:28.266729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b709060b-801e-4276-87a6-e19285c96915 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.240848 Jun 02 09:12:28.267318 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 107/210] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:28 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:29.255562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:29.256195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:29.262198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:29.262895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:29.263683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:29.264123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:29.283520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:29.284122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:29.291564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:29.292012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:29.292878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:29.293311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:29.460818 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:29.465133 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:29.468203 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f23279ba-a333-4756-912d-2111e4940bb2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.216463 Jun 02 09:12:29.468769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 104/211] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:29 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:29.473033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e438840e-3fcf-4f2b-9bd3-75aa307b8596 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.193722 Jun 02 09:12:29.473764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 108/212] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:29 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:30.486134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:30.486664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:30.489504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:30.490175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:30.493631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:30.494076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:30.494836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:30.495296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:30.497309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:30.497766 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:30.498533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:30.498975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:30.513766 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:30.689415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:30.693494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:30.696962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d0cb53cd-de16-49b5-9045-b97b37171aac tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.214662 Jun 02 09:12:30.697525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 105/213] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:30 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:30.701040 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5ec225af-40c5-48c6-8342-3f32c3ca187c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.215183 Jun 02 09:12:30.701598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 109/214] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:30 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:31.713193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:31.714373 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:31.717347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:31.717968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:31.721206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:31.721827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:31.722611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:31.723047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:31.724865 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:31.725368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:31.726137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:31.726576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:31.916064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:31.935110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:31.939455 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-baeab7a0-5219-419e-9f6f-9f98a8527d65 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.230357 Jun 02 09:12:31.940032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 106/215] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:31 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:31.948579 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-61d9675a-f39b-4fc2-9112-8f67ee3c28a9 req-12d01d8f-8450-41a0-a8e8-1615e1e54f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b36e287-3afe-4307-b0ae-b20d9b8ff5f2", "name": "network-vif-plugged", "status": "completed", "tag": "3bf89d97-fde9-4063-becd-7aff4a5bcc5f"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:31.953042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-db04b0cf-b2fd-4a5c-84bf-35e8b79e0e8c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.239561 Jun 02 09:12:31.953619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 110/216] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:31 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:31.963295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-61d9675a-f39b-4fc2-9112-8f67ee3c28a9 req-12d01d8f-8450-41a0-a8e8-1615e1e54f8a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:31.963751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-61d9675a-f39b-4fc2-9112-8f67ee3c28a9 req-12d01d8f-8450-41a0-a8e8-1615e1e54f8a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:31.974557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-61d9675a-f39b-4fc2-9112-8f67ee3c28a9 req-12d01d8f-8450-41a0-a8e8-1615e1e54f8a service nova] Creating event network-vif-plugged:3bf89d97-fde9-4063-becd-7aff4a5bcc5f for instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 on hv-cinder-82549 Jun 02 09:12:31.980188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-61d9675a-f39b-4fc2-9112-8f67ee3c28a9 req-12d01d8f-8450-41a0-a8e8-1615e1e54f8a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Jun 02 09:12:31.980752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 107/217] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:32.128575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dbb92a6f-4a3d-411a-ad15-0996dddf7507 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670479af0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:32.176751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dbb92a6f-4a3d-411a-ad15-0996dddf7507 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/717baf7a-2942-4efe-a663-5e5a75e0e40a" status: 200 len: 350 microversion: 2.1 time: 0.052071 Jun 02 09:12:32.177392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 111/218] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:12:32 2022] GET /compute/v2.1/os-volumes/717baf7a-2942-4efe-a663-5e5a75e0e40a => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:32.957814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:32.958745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:32.966059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:32.966582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:32.967454 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:32.967950 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:32.969985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:32.975843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=100 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:32.975998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:32.981373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:32.982026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:32.982814 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:32.983268 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:33.257901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:33.269442 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ca421ede-3d4a-4d4c-a3a8-0c4d62ccd452 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.316618 Jun 02 09:12:33.274412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 108/219] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:32 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:33.316892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:33.324531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9a1f37e6-cd83-403e-b4a3-35788922413f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1521 microversion: 2.1 time: 0.358383 Jun 02 09:12:33.325090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 112/220] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:32 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:33.946592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f77c8f74-5a76-4ee0-a415-a06aff7bebdd tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670c82790>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:33.995119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f77c8f74-5a76-4ee0-a415-a06aff7bebdd tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/bec26f65-6562-4fcd-b91f-99014d49985f" status: 200 len: 351 microversion: 2.1 time: 0.052919 Jun 02 09:12:33.995817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 109/221] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:12:33 2022] GET /compute/v2.1/os-volumes/bec26f65-6562-4fcd-b91f-99014d49985f => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:34.290873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:34.291439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:34.297937 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.298397 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.299166 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.299630 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.342035 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:34.346415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:34.349747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.350754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.351581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.352075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.474816 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:34.490197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dde639f3-565d-4698-bada-e251af8ca61a tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1314 microversion: 2.1 time: 0.203593 Jun 02 09:12:34.491647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 113/222] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:34 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:34.536190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:34.546702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c3fcf93f-1595-4bca-93c1-f0a9460c78f1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1501 microversion: 2.1 time: 0.206532 Jun 02 09:12:34.546702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 110/223] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:34 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:34.562187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:34.562927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:34.570178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.570617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.571406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:34.573554 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:34.705551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:34.713879 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d8d7ed3a-7600-44fd-8e8f-e504fbf6254b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1515 microversion: 2.1 time: 0.156697 Jun 02 09:12:34.714251 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 114/224] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:34 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:35.507390 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:35.508003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:35.514337 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:35.514781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:35.515679 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:35.516111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:35.667338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:35.676598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4df065af-fb33-4ecd-9453-5dc17883e173 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1498 microversion: 2.1 time: 0.173514 Jun 02 09:12:35.677327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 111/225] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:35 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:35.920423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0bad74bc-41a0-47ff-a3ce-8e52527de84a tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f96704d3310>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.411565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0bad74bc-41a0-47ff-a3ce-8e52527de84a tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/cba82220-1e8a-4d66-b29d-406b082c3530" status: 200 len: 350 microversion: 2.1 time: 0.488047 Jun 02 09:12:36.411565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 115/226] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:12:35 2022] GET /compute/v2.1/os-volumes/cba82220-1e8a-4d66-b29d-406b082c3530 => generated 350 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:36.415866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-05a80f5b-d9e8-4119-82ec-a754062a2db1 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670df2dc0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.561809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-05a80f5b-d9e8-4119-82ec-a754062a2db1 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.149799 Jun 02 09:12:36.562362 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 112/227] 10.222.0.18 () {58 vars in 1133 bytes} [Thu Jun 2 09:12:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:36.575008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ce5d6e1e-ad70-49cf-b9fe-b4ed182299e6 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670488700>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.655983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ce5d6e1e-ad70-49cf-b9fe-b4ed182299e6 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084641 Jun 02 09:12:36.656545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 116/228] 10.222.0.18 () {58 vars in 1148 bytes} [Thu Jun 2 09:12:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:36.667954 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-579d8de4-be19-49bc-acdc-3a3c9d6ea732 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670c82b80>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.723487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:36.724559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:36.731267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:36.731719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:36.732490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:36.732926 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:36.755612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'flavor' on Instance uuid 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:12:36.779904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-579d8de4-be19-49bc-acdc-3a3c9d6ea732 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.115561 Jun 02 09:12:36.780562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1133 bytes} [Thu Jun 2 09:12:36 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:36.791831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8ae7d7f1-b741-4020-a67c-872e20f88a52 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670d85940>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.872574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8ae7d7f1-b741-4020-a67c-872e20f88a52 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084303 Jun 02 09:12:36.873148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 114/230] 10.222.0.18 () {58 vars in 1166 bytes} [Thu Jun 2 09:12:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:36.885113 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-66a64519-a255-415d-abbc-3f84b420121f tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670d85d30>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:36.993205 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-66a64519-a255-415d-abbc-3f84b420121f tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.112251 Jun 02 09:12:36.993780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 115/231] 10.222.0.18 () {58 vars in 1169 bytes} [Thu Jun 2 09:12:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:12:37.010383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-103b6feb-fa62-40dd-ad43-ad6ce12e58ae tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670df29d0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:37.091044 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-103b6feb-fa62-40dd-ad43-ad6ce12e58ae tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087103 Jun 02 09:12:37.091647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1154 bytes} [Thu Jun 2 09:12:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:37.102766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c003406c-7357-4f90-b4b0-0be8378f715a tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670c829d0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:37.126358 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a5490df3-912a-4d0d-8e48-82b050ee78c7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/action" status: 200 len: 32 microversion: 2.1 time: 0.406759 Jun 02 09:12:37.126982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 117/233] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:12:36 2022] POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:12:37.136184 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:37.136874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:37.144110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:37.144564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:37.145330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:37.145767 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:37.190247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c003406c-7357-4f90-b4b0-0be8378f715a tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091394 Jun 02 09:12:37.190812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1187 bytes} [Thu Jun 2 09:12:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:12:37.204056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-57b6123f-6470-46aa-a62c-5afe82757a48 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] Calling method '.version_select at 0x7f9670dc2940>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:37.304155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-57b6123f-6470-46aa-a62c-5afe82757a48 tempest-VolumesTestJSON-1419827778 tempest-VolumesTestJSON-1419827778-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.103232 Jun 02 09:12:37.304720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 118/235] 10.222.0.18 () {58 vars in 1154 bytes} [Thu Jun 2 09:12:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:37.359729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:37.368031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ffd08925-aa0c-439f-bf5d-99f655a81935 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.235857 Jun 02 09:12:37.368599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 118/236] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:37 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:37.772948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:37.773532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:37.779534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:37.779978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:37.780746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:37.781193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:37.806282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:12:38.127885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f5b0c986-afd5-4359-90d1-1be88a55e7a5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 204 len: 0 microversion: 2.1 time: 0.358690 Jun 02 09:12:38.128618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:12:37 2022] DELETE /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:12:38.137105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:38.137976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:38.144768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:38.145218 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:38.146054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:38.146520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:38.277089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:38.284582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f66a9a08-8a6a-4194-b5ba-c0b044665e59 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1504 microversion: 2.1 time: 0.151598 Jun 02 09:12:38.285191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:38 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:38.385813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:38.386607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:38.389017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:38.394198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:38.394640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:38.395629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:38.396426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:38.536279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:38.538254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-52f08604-fccc-4153-a61a-73ebb4375dd2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.156283 Jun 02 09:12:38.538812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 120/239] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:38 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:39.301995 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:39.302599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:39.309830 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:39.310274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:39.311127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:39.311583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:39.468848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:39.477550 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2f0fbf5a-2f10-481f-8b16-2c13ae671bc4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1504 microversion: 2.1 time: 0.179315 Jun 02 09:12:39.479494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 120/240] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:39 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:39.558053 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:39.558806 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:39.565453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:39.565902 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:39.566867 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:39.567357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:39.781296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:39.792299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-802071c9-5db4-42f6-a26a-1199b75ca85a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.240517 Jun 02 09:12:39.792997 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 121/241] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:39 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:40.497994 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:40.498593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:40.505213 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:40.505649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:40.506991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:40.507458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:40.810078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:40.810693 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:40.817761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:40.818495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:40.820121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:40.820557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:40.957678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:40.968333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4e63f586-dc39-4754-905a-13db519c7725 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1504 microversion: 2.1 time: 0.473932 Jun 02 09:12:40.969292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 121/242] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:40 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:41.000833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-69b30a9a-2a4c-404f-b2b5-5c38ef53f1db req-93598373-eb99-4d05-a39a-59292d7d3d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b36e287-3afe-4307-b0ae-b20d9b8ff5f2", "name": "network-vif-deleted", "tag": "3bf89d97-fde9-4063-becd-7aff4a5bcc5f"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:41.008933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-69b30a9a-2a4c-404f-b2b5-5c38ef53f1db req-93598373-eb99-4d05-a39a-59292d7d3d84 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:41.009367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-69b30a9a-2a4c-404f-b2b5-5c38ef53f1db req-93598373-eb99-4d05-a39a-59292d7d3d84 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:41.020562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-69b30a9a-2a4c-404f-b2b5-5c38ef53f1db req-93598373-eb99-4d05-a39a-59292d7d3d84 service nova] Creating event network-vif-deleted:3bf89d97-fde9-4063-becd-7aff4a5bcc5f for instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 on hv-cinder-82549 Jun 02 09:12:41.025894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-69b30a9a-2a4c-404f-b2b5-5c38ef53f1db req-93598373-eb99-4d05-a39a-59292d7d3d84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028703 Jun 02 09:12:41.026496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 122/243] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:41.043756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:41.051402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e08673ac-e5ee-4064-a6b0-40458bd6c5eb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.245037 Jun 02 09:12:41.051959 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 122/244] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:40 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:41.986958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:41.988270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:42.000262 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:42.000718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:42.005508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:42.005508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:42.048180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:42.049155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:42.049777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lazy-loading 'fault' on Instance uuid 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:12:42.072119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:42.073450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:42.105394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:42.106210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:42.107202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:42.108767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:42.149941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:42.164123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-feb1f8dd-293c-448b-9cba-76008abd411b tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 200 len: 1304 microversion: 2.1 time: 0.182310 Jun 02 09:12:42.166354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 123/245] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:41 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:42.321625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:42.329871 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-901de008-06a0-4f90-912a-8f0386b77d55 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.264552 Jun 02 09:12:42.331607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 123/246] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:42 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:43.189897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:43.190703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:43.197689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.197904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.198714 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.199579 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.215484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] HTTP exception thrown: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Request method failure captured: Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 HTTP/1.1 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH7sWCQE5_U5D3a0jA_jTUeABl2y8foLKJwMv3oBjwnzTXwITCbLXh1fXJ68f9ZDR6T7HnOB05rhB6xfWtB9cw0WSYbBduKFs8wZ7FCkzCm5o5r66W8Zb829CdXF6aQCD9ISP8IjuPDzcdbjg5Zc5tTmsE9V8dT0p5Oq29crdHoQE-U Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: f835785be0684dc7a270a89a093e9609 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesActionsTest-13953429 Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:12:43.217378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f835785be0684dc7a270a89a093e9609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f835785be0684dc7a270a89a093e9609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f835785be0684dc7a270a89a093e9609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f835785be0684dc7a270a89a093e9609", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesActionsTest-13953429 Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: f835785be0684dc7a270a89a093e9609 Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesActionsTest-13953429 Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesActionsTest-13953429-project Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 75b429eb57bd41baaa1a0952ca63eeab Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesActionsTest-13953429-project Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. Jun 02 09:12:43.218624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '8b36e287-3afe-4307-b0ae-b20d9b8ff5f2'} Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:43.219375 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. Jun 02 09:12:43.220529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:12:43.222307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Returning 404 to user: Instance 8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:43.223333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7b72415c-ad53-4190-bb47-1deb2a59846c tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2" status: 404 len: 111 microversion: 2.1 time: 0.038208 Jun 02 09:12:43.224086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 124/247] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:43 2022] GET /compute/v2.1/servers/8b36e287-3afe-4307-b0ae-b20d9b8ff5f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:12:43.349063 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:43.350333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:43.356492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.356936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.358114 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.358543 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.373115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-447153349", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "networks": [{"uuid": "6fdaaf9d-a64b-40f4-abb6-cbdf593b2ddc"}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:43.433682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] validate_networks() for [('6fdaaf9d-a64b-40f4-abb6-cbdf593b2ddc', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:12:43.654103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:43.665027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c7b5673c-6cad-410e-a27b-9b1c81d15455 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.320232 Jun 02 09:12:43.668069 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 124/248] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:43 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:43.915922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:12:43.917898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:12:43.919780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:12:43.920344 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:12:43.921601 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:12:43.937328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.937783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.940211 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:43.941326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:43.961488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Getting quotas for project f835785be0684dc7a270a89a093e9609. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:12:43.965698 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Getting quotas for user 75b429eb57bd41baaa1a0952ca63eeab and project f835785be0684dc7a270a89a093e9609. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:12:43.977627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:12:43.980289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:12:44.166178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2b6d20a8-51e7-4c53-a12e-f52c77d19be5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796688 Jun 02 09:12:44.166936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 125/249] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 09:12:44.177122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-85e44bb7-622d-4ee6-9a46-34472f8c7faf tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:44.177728 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-85e44bb7-622d-4ee6-9a46-34472f8c7faf tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:44.252789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-85e44bb7-622d-4ee6-9a46-34472f8c7faf tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:44.259772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-85e44bb7-622d-4ee6-9a46-34472f8c7faf tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1213 microversion: 2.1 time: 0.086513 Jun 02 09:12:44.260343 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 125/250] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:44 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:44.684323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:44.684934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:44.692087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:44.692536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:44.693309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:44.694286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:44.872929 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:44.883092 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7617f10c-1480-4421-9591-85e3b15865bd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.202575 Jun 02 09:12:44.884219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 126/251] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:44 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:45.280940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:45.281677 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:45.288615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:45.289306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:45.290182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:45.290776 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:45.360089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:45.368895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-919a8d8b-0485-470b-888d-0da860e91415 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1217 microversion: 2.1 time: 0.092205 Jun 02 09:12:45.371335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 126/252] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:45 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:45.900471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:45.901107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:45.908310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:45.908823 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:45.909668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:45.910106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:46.059582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:46.067064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ed5bab17-a349-49fc-ac4f-2abdc80200e0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.170888 Jun 02 09:12:46.067665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 127/253] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:45 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:46.386081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:46.386767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:46.393104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:46.393542 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:46.394297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:46.394726 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:46.478890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:46.487148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-64cbc30a-dab3-413a-9df3-8eead9f9aa0e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1265 microversion: 2.1 time: 0.105391 Jun 02 09:12:46.487739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 127/254] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:46 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:47.088239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:47.089424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:47.106557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:47.107003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:47.107841 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:47.108269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:47.434773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:47.437131 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:47.442901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-07b0902b-c984-4aab-9d2d-264583239abd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.358542 Jun 02 09:12:47.443629 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 128/255] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:47 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:47.504455 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:47.505681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:47.515705 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:47.516154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:47.516928 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:47.517363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:47.586426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:47.593976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-530c9918-7d5a-4253-a0e7-c00edd7bc390 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1271 microversion: 2.1 time: 0.093397 Jun 02 09:12:47.594527 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 128/256] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:47 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:48.459950 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:48.460490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:48.467423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:48.467881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:48.468662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:48.469098 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:48.611955 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:48.612569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:48.619679 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:48.621678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:48.622481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:48.622915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:48.842872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:48.859282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-38d256ad-6643-4697-a4fe-4fca192e0fc6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.403653 Jun 02 09:12:48.859928 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 129/257] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:48 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:48.940065 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:48.949139 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2d3f39f2-e9d2-48ae-8a72-135a8b2c92a0 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.341246 Jun 02 09:12:48.950097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 129/258] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:48 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:49.420947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-97fc35f5-3937-4f75-9336-5ac41c5d5794 req-e4ea397b-ed60-4db3-865c-ce63a7830729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f312da-e4d7-4a07-ad55-873747d143fc", "tag": "5bad3754-ed86-40cb-aebc-520d042367f6"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:49.438814 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-97fc35f5-3937-4f75-9336-5ac41c5d5794 req-e4ea397b-ed60-4db3-865c-ce63a7830729 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:49.442362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-97fc35f5-3937-4f75-9336-5ac41c5d5794 req-e4ea397b-ed60-4db3-865c-ce63a7830729 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:49.457453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-97fc35f5-3937-4f75-9336-5ac41c5d5794 req-e4ea397b-ed60-4db3-865c-ce63a7830729 service nova] Creating event network-changed:5bad3754-ed86-40cb-aebc-520d042367f6 for instance b7f312da-e4d7-4a07-ad55-873747d143fc on hv-cinder-82549 Jun 02 09:12:49.464152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-97fc35f5-3937-4f75-9336-5ac41c5d5794 req-e4ea397b-ed60-4db3-865c-ce63a7830729 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048109 Jun 02 09:12:49.464777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 130/259] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:49.884411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:49.885177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:49.891835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:49.892279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:49.893042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:49.893471 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:49.966616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:49.967341 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:49.978645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:49.979097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:49.980082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:49.980520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:50.179785 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:50.188376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bbffcd2d-e729-43fa-a3ef-64763216a53c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.315612 Jun 02 09:12:50.191703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 130/260] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:49 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:50.303344 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:50.313518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-730c0332-14f1-4b34-8f6a-cf58190895a3 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.350844 Jun 02 09:12:50.319300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 131/261] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:49 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:51.216146 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:51.217789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:51.225718 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.226232 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.227348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.228244 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.339205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:51.339966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:51.348140 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.348794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.350382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.351323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.517272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:51.526386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5d10aa51-04e8-4544-aa73-021bb9b0df8d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1501 microversion: 2.1 time: 0.317460 Jun 02 09:12:51.526952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 131/262] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:51 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1501 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:51.542490 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1d26b54-f95c-4a65-9ca5-7c3171e02931"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:51.543964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:51.550421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.550869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.551742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.552343 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.556411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:51.578739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] HTTP exception thrown: Cannot 'attach_volume' instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d while it is in vm_state rescued Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Request method failure captured: Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/os-volume_attachments HTTP/1.1 Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 74 Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6w0b80vt-MQlcq-rUG7Y9zL3GFQiyXgT_4p4h71aQnB1saVZjqYoQ-CusqKGm-oyxy8HWoeWhhylre4Z1o4bfZdLw3mb2yE9nw9ROkdq2Ic4WU_Zm1PJWmj3fLCKU_nKSHEwdJjsh0EiEoKE-NwlFqX2b2EZNkfTvkMX42MEH8bkc Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:12:51.580457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1869e20213214111a0dfcda8b7abeecc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: bc0272ac06464fb7b430bc8c664208dd Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volumeAttachment": {"volumeId": "f1d26b54-f95c-4a65-9ca5-7c3171e02931"}} Jun 02 09:12:51.582344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Cannot 'attach_volume' instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d while it is in vm_state rescued Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'server_id': '9cfeba25-7463-4c2e-a76e-8fb2dfaae97d', 'body': {'volumeAttachment': {'volumeId': 'f1d26b54-f95c-4a65-9ca5-7c3171e02931'}}} Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:12:51.583073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d while it is in vm_state rescued Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:12:51.585332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d while it is in vm_state rescued Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Returning 409 to user: Cannot 'attach_volume' instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d while it is in vm_state rescued {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3c92937b-70fa-4725-b54c-8b10e3b9cedb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043287 Jun 02 09:12:51.586607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 132/263] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:12:51 2022] POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 02 09:12:51.593518 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:51.594155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:51.604778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:51.611669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.612186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-096b1119-5588-4bf0-9943-0090cfa8a62d tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.283896 Jun 02 09:12:51.612337 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.614205 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.616446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.619957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 132/264] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:51 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:51.869913 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-49881188-20e6-40e7-b4c6-dbab840ad3e9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/action" status: 202 len: 0 microversion: 2.1 time: 0.280666 Jun 02 09:12:51.873572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 133/265] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:12:51 2022] POST /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 09:12:51.878683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:51.879473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:51.882084 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:51.886806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.891997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:51.891997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:51.891997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:52.017109 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:52.024665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f1ca04f7-7436-433c-91c1-dc9fa1831e51 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1509 microversion: 2.1 time: 0.149863 Jun 02 09:12:52.025237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 133/266] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:51 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:52.129969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:52.130605 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:52.137103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:52.137812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:52.138553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:52.138981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:52.161468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-afbc5d49-5c54-41b6-91c5-c00de4b1b74e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/ips" status: 200 len: 147 microversion: 2.1 time: 0.036054 Jun 02 09:12:52.162495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 134/267] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:12:52 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:52.628943 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:52.629583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:52.637217 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:52.638056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:52.638925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:52.639395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:52.770028 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:52.778125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-130ff3e7-a119-4bbf-a0c0-92fb100fd8b1 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.153069 Jun 02 09:12:52.778699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 134/268] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:52 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:53.042162 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:53.042881 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:53.049303 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:53.049748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:53.050553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:53.050994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:53.262124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:53.269844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cbcfdb92-824e-4496-9d67-7462905a652c tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1509 microversion: 2.1 time: 0.231964 Jun 02 09:12:53.270418 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 135/269] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:53 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:53.795992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:53.796596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:53.804122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:53.804565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:53.805330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:53.805853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:53.955181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:53.957501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:53.964590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ad4caae0-17fe-4007-b10a-a87083a5f7b2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.172879 Jun 02 09:12:53.965445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 135/270] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:53 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:54.287357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:54.288041 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:54.290972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.296572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:54.297192 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:54.298246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:54.298766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:54.445089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:54.452819 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-de7cf088-90d7-437c-8fc5-09c5e260417d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1509 microversion: 2.1 time: 0.170034 Jun 02 09:12:54.455364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 136/271] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:54 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:54.758225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:54.759005 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:54.760997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:12:54.767087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:54.767568 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:54.768359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:54.768941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:54.795854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-de9d9460-7c17-4c91-ab46-12d6c5b5e673 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/ips" status: 200 len: 151 microversion: 2.20 time: 0.042392 Jun 02 09:12:54.796430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 136/272] 10.222.0.18 () {60 vars in 1288 bytes} [Thu Jun 2 09:12:54 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:12:54.983585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:54.984330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:54.992309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:54.992902 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:54.993697 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:55.001311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:55.203364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:55.212753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-457520be-8933-415c-acde-3097d3b672dc tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.234989 Jun 02 09:12:55.221934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:54 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:55.470804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:55.472054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:55.480122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:55.480575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:55.481447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:55.481886 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:55.688729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:55.698571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-25eb9873-5533-48f0-b06d-4544af4ddae9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1509 microversion: 2.1 time: 0.232324 Jun 02 09:12:55.699097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 137/274] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:55 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:55.932740 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-19a8f053-7c5d-4bb7-8be5-1ae1d24432b9 req-9a53c998-f2fe-43cd-b07f-a3582958c502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f312da-e4d7-4a07-ad55-873747d143fc", "name": "network-vif-plugged", "status": "completed", "tag": "5bad3754-ed86-40cb-aebc-520d042367f6"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:55.958514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-19a8f053-7c5d-4bb7-8be5-1ae1d24432b9 req-9a53c998-f2fe-43cd-b07f-a3582958c502 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:55.966358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-19a8f053-7c5d-4bb7-8be5-1ae1d24432b9 req-9a53c998-f2fe-43cd-b07f-a3582958c502 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:55.978336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-19a8f053-7c5d-4bb7-8be5-1ae1d24432b9 req-9a53c998-f2fe-43cd-b07f-a3582958c502 service nova] Creating event network-vif-plugged:5bad3754-ed86-40cb-aebc-520d042367f6 for instance b7f312da-e4d7-4a07-ad55-873747d143fc on hv-cinder-82549 Jun 02 09:12:55.983678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-19a8f053-7c5d-4bb7-8be5-1ae1d24432b9 req-9a53c998-f2fe-43cd-b07f-a3582958c502 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054868 Jun 02 09:12:55.984437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 138/275] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:56.089694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2825270-6992-4219-8bdd-eb334c9d80c4"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:56.091055 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:56.102659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.102659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.102659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.102659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.230954 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:56.235757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:56.242260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.242702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.243499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.244123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.401415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:56.409643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-aad39740-e806-4ba0-85fa-20342780c782 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.183015 Jun 02 09:12:56.410238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 139/276] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:56 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:56.715572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:56.716185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:56.722144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.722592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.723393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:56.723830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:56.884103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:56.892979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4e6a474f-bba7-43cf-acec-bf6146bc9bdb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1515 microversion: 2.1 time: 0.181145 Jun 02 09:12:56.904787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 140/277] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:56 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:56.936170 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-22727565-4921-4738-9b49-e065e8eb4b4b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848015 Jun 02 09:12:56.940728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 138/278] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:12:56 2022] POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:57.265247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:57.265899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:57.273472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:57.274200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:57.275406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:57.275934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:57.304617 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lazy-loading 'flavor' on Instance uuid 02b7a340-7dfe-47ad-b8c2-3caa63dda45f {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:12:57.427962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:57.428665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:57.434848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:57.435331 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:57.436104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:57.436541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:57.623641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:57.631899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-753e032f-0f24-419b-a505-913d03c37cc2 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1313 microversion: 2.1 time: 0.208956 Jun 02 09:12:57.632565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 139/279] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:57 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:12:58.020684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-342c4e1f-f483-49e6-848c-765e9207c0bb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/action" status: 202 len: 0 microversion: 2.20 time: 0.757063 Jun 02 09:12:58.020684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 141/280] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 2 09:12:57 2022] POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/action => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:12:58.027078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:58.027719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:58.033668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:58.034123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:58.034893 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:58.035361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:58.195937 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:58.204056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:58.205566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:58.206730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6c1e5e05-bb02-4b05-8eaf-4be7b76a72f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.183483 Jun 02 09:12:58.207323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 140/281] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:12:58 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:12:58.614471 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3084db28-32e3-49b2-b161-cf98337fd969 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: .version_select at 0x7f9670c825e0>, body: {"keypair": {"name": "tempest-keypair-2003485134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYNzXErX17qwfqTnYOKxg7Fj+ihy7GtqHpdfnpJCCqgcK9Ls1HspEYoMuxPNzCfa4iIPUNSuT/CH1qVk/0la8MCs0k/PMuiW4RJN/nffUsh3aYlwTV9Iv6lSEfjehhA2A=="}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:12:58.632836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-3084db28-32e3-49b2-b161-cf98337fd969 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for project 1869e20213214111a0dfcda8b7abeecc. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:12:58.636795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-3084db28-32e3-49b2-b161-cf98337fd969 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for user bc0272ac06464fb7b430bc8c664208dd and project 1869e20213214111a0dfcda8b7abeecc. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:12:58.649547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:58.650307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:58.658409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:58.659025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:58.660075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:58.666145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:58.750314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3084db28-32e3-49b2-b161-cf98337fd969 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140364 Jun 02 09:12:58.750904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 142/282] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:12:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:12:58.818474 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:58.826225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-04dd173a-9b80-4a1b-b1f6-21bea5d20467 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1496 microversion: 2.1 time: 0.180795 Jun 02 09:12:58.827026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 141/283] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:12:58 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:12:59.224980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:59.225716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:59.232034 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:59.232483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:59.233449 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:59.233903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:59.418574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:59.431426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:59.434794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:12:59.436762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-264383bf-24f4-47a1-8ef4-6cfda71ce583 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.215711 Jun 02 09:12:59.437475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 143/284] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:12:59 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:12:59.921581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:12:59.922222 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:12:59.929543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:59.930240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:59.931489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:12:59.932132 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:12:59.960581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:13:00.408923 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-358ae389-59cb-466c-add2-7dff1b17deb4 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 204 len: 0 microversion: 2.1 time: 0.491489 Jun 02 09:13:00.418607 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 142/285] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:12:59 2022] DELETE /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:13:00.419424 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:00.420695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:00.429432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:00.429869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:00.437966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:00.437966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:00.458164 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:00.459667 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:00.469757 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:00.470595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:00.471855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:00.472596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:00.501599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:00.819085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:00.827143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8bfcee91-58a5-4a55-a68a-7c4750c94338 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1502 microversion: 2.1 time: 0.412485 Jun 02 09:13:00.829758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:00.830554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 144/286] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:00 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:00.843531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:00.845002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:00.846156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3681ce80-d17d-446a-893d-8b9d89b038cb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.393724 Jun 02 09:13:00.846729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 143/287] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:00 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:01.530338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1788165304", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ffec283-4d25-408f-ae56-198b57483577"}], "security_groups": [{"name": "tempest-securitygroup--2062860979"}], "key_name": "tempest-keypair-2003485134", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:01.648183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] validate_networks() for [('1ffec283-4d25-408f-ae56-198b57483577', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:13:01.847149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:01.847855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:01.856137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:01.856868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:01.859385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:01.859385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:02.101970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:02.110637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-09651953-0098-4b69-b88d-ef89cc8c4d4f tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1502 microversion: 2.1 time: 0.267583 Jun 02 09:13:02.111695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:01 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1502 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:02.119307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:02.120430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:02.128032 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:02.129550 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:02.130721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:02.131380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:02.153468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:13:02.153921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:13:02.154394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:13:02.154800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:13:02.155207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:13:02.173479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:02.174123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:02.175093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:02.178484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:02.197499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:13:02.202843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Getting quotas for user bc0272ac06464fb7b430bc8c664208dd and project 1869e20213214111a0dfcda8b7abeecc. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:13:02.215711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:13:02.218279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:13:02.276281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:02.285282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:02.288079 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:02.289732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2c68731d-c46c-42b9-a7ed-510228613c1c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.176530 Jun 02 09:13:02.290513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 145/289] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:02 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:02.370884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-815c2882-1d12-4f01-8d27-49312d35d415 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.848099 Jun 02 09:13:02.382822 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 145/290] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:13:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:13:02.385426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2de0a3a3-c849-42e9-b0a1-cca01fda6c2d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:02.386523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2de0a3a3-c849-42e9-b0a1-cca01fda6c2d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:02.526942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2de0a3a3-c849-42e9-b0a1-cca01fda6c2d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:02.540239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2de0a3a3-c849-42e9-b0a1-cca01fda6c2d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1246 microversion: 2.1 time: 0.159251 Jun 02 09:13:02.541150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 146/291] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:02 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1246 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:03.068706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-9dc0191c-7c45-4a54-a855-588beb8c1301 req-3345adc3-c84e-4343-8c19-96cf220c2fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f312da-e4d7-4a07-ad55-873747d143fc", "name": "network-vif-deleted", "tag": "5bad3754-ed86-40cb-aebc-520d042367f6"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:03.083123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-9dc0191c-7c45-4a54-a855-588beb8c1301 req-3345adc3-c84e-4343-8c19-96cf220c2fd3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.083629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-9dc0191c-7c45-4a54-a855-588beb8c1301 req-3345adc3-c84e-4343-8c19-96cf220c2fd3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.101473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-9dc0191c-7c45-4a54-a855-588beb8c1301 req-3345adc3-c84e-4343-8c19-96cf220c2fd3 service nova] Creating event network-vif-deleted:5bad3754-ed86-40cb-aebc-520d042367f6 for instance b7f312da-e4d7-4a07-ad55-873747d143fc on hv-cinder-82549 Jun 02 09:13:03.121719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-9dc0191c-7c45-4a54-a855-588beb8c1301 req-3345adc3-c84e-4343-8c19-96cf220c2fd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057143 Jun 02 09:13:03.122776 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 146/292] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:03.132533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:03.135684 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:03.144252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.144713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.145521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.146036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.367418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:03.367418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9b222a38-bdb9-412e-bf71-2cc3bee2689e tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1460 microversion: 2.1 time: 0.138929 Jun 02 09:13:03.367418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 147/293] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:03 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1460 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:03.368560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:03.368560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:03.368560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.368560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.369456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.369456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.531896 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:03.540507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:03.542004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:03.543155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f115931f-81e2-4a78-b9e6-ca04287c7406 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.238206 Jun 02 09:13:03.543752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 147/294] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:03 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:03.558261 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:03.558919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:03.565129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.565572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.566334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:03.566864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:03.652086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:03.660626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4ee9b333-85bb-4ef6-8b4d-eed175e59f88 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1250 microversion: 2.1 time: 0.106511 Jun 02 09:13:03.662469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 148/295] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:03 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:04.374177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:04.374792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:04.381633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.382292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.383092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.383711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.414533 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.414979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.415464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lazy-loading 'fault' on Instance uuid b7f312da-e4d7-4a07-ad55-873747d143fc {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:13:04.455849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:04.463870 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f2d1a1a9-9f70-47fe-968c-2d8ef9b8ed52 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1303 microversion: 2.1 time: 0.093443 Jun 02 09:13:04.464433 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:04 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:04.562023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:04.562631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:04.570305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.570929 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.571798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.572316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.678330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:04.680517 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:04.685935 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.686641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.687509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:04.688195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:04.694121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:04.716354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:04.724552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:04.726050 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:04.727196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c57a7a30-5c5f-47d7-a271-d25e000dc26a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.169235 Jun 02 09:13:04.734378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 149/297] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:04 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:04.763821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:04.771286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-908f9822-cb76-4fd8-9f64-ebf7c2d9ada4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1250 microversion: 2.1 time: 0.097094 Jun 02 09:13:04.772058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:04 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:05.484970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:05.485506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:05.491585 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.492036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.492805 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.493240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.523607 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.524054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.524499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lazy-loading 'fault' on Instance uuid b7f312da-e4d7-4a07-ad55-873747d143fc {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:13:05.586711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:05.595089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7a8a6ada-8fdb-4e89-9796-b0da6b27b295 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1303 microversion: 2.1 time: 0.113892 Jun 02 09:13:05.596196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 150/299] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:05 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:05.748201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:05.751855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:05.756786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.757233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.758070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.758498 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.788839 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:05.790423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:05.799429 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.800105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.801091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:05.801518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:05.891321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:05.899858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6ae2f2d4-caff-4322-a8c7-d54c8071cd4e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1250 microversion: 2.1 time: 0.115162 Jun 02 09:13:05.900694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 151/300] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:05 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1250 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:05.941230 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:05.950719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:05.953618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:05.953618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1552fbd0-4548-4778-b99e-98233204df96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.210615 Jun 02 09:13:05.954323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 150/301] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:05 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:06.612509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:06.616806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:06.621227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.621711 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.622454 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.622945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.655874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.656315 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.656806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lazy-loading 'fault' on Instance uuid b7f312da-e4d7-4a07-ad55-873747d143fc {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:13:06.703122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:06.711930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-69096f5d-db4b-4118-b7a2-1d25dfc862ed tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1303 microversion: 2.1 time: 0.103375 Jun 02 09:13:06.713145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 152/302] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:06 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:06.917146 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:06.917764 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:06.926840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.928127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.928670 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.929288 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.973894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:06.974786 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:06.981557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.982000 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.982811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:06.983262 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:06.993944 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:07.003262 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2129d5cb-c8b3-4927-9614-0cf86528d7a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1242 microversion: 2.1 time: 0.090292 Jun 02 09:13:07.007324 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:06 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:07.143759 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:07.156525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:07.158509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:07.160024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fd450f7d-fdee-4095-95d8-6ceaaf1165bc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.190365 Jun 02 09:13:07.160858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 153/304] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:06 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:07.732381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:07.732995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:07.740144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:07.740594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:07.741383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:07.742075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:07.776543 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:07.777039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:07.777486 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lazy-loading 'fault' on Instance uuid b7f312da-e4d7-4a07-ad55-873747d143fc {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:13:07.820759 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b429eb57bd41baaa1a0952ca63eeab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f835785be0684dc7a270a89a093e9609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:07.828589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-37d8f53c-df18-4850-8a0b-26e42aa23af8 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 200 len: 1303 microversion: 2.1 time: 0.102176 Jun 02 09:13:07.829904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 152/305] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:07 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:08.022119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:08.023961 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:08.031421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.031932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.032811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.033311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.100509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:08.108055 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bd2a3105-3eba-495a-a570-abd516cfe540 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1298 microversion: 2.1 time: 0.090657 Jun 02 09:13:08.108614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 154/306] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:08 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:08.179372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:08.179910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:08.186446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.192151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.192151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.192151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.330111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:08.338200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:08.339806 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:08.341016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-663fd703-68ff-4403-bf4c-d79d8af1a06a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.165729 Jun 02 09:13:08.341596 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 153/307] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:08 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:08.849587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:08.849587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] [instance: b7f312da-e4d7-4a07-ad55-873747d143fc] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:08.853494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.853943 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.854837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:08.855291 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:08.869374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] HTTP exception thrown: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Request method failure captured: Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc HTTP/1.1 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH7sWCQE5_U5D3a0jA_jTUeABl2y8foLKJwMv3oBjwnzTXwITCbLXh1fXJ68f9ZDR6T7HnOB05rhB6xfWtB9cw0WSYbBduKFs8wZ7FCkzCm5o5r66W8Zb829CdXF6aQCD9ISP8IjuPDzcdbjg5Zc5tTmsE9V8dT0p5Oq29crdHoQE-U Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: f835785be0684dc7a270a89a093e9609 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesActionsTest-13953429 Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:13:08.870999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f835785be0684dc7a270a89a093e9609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f835785be0684dc7a270a89a093e9609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f835785be0684dc7a270a89a093e9609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f835785be0684dc7a270a89a093e9609", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesActionsTest-13953429 Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: f835785be0684dc7a270a89a093e9609 Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesActionsTest-13953429 Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesActionsTest-13953429-project Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 75b429eb57bd41baaa1a0952ca63eeab Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesActionsTest-13953429-project Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. Jun 02 09:13:08.872602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'b7f312da-e4d7-4a07-ad55-873747d143fc'} Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:13:08.873509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. Jun 02 09:13:08.874933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:13:08.878038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] Returning 404 to user: Instance b7f312da-e4d7-4a07-ad55-873747d143fc could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:13:08.878038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-419703da-0b70-4543-aafb-473e76a29fd5 tempest-VolumesActionsTest-13953429 tempest-VolumesActionsTest-13953429-project] 10.222.0.18 "GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc" status: 404 len: 111 microversion: 2.1 time: 0.030296 Jun 02 09:13:08.878038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 155/308] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:08 2022] GET /compute/v2.1/servers/b7f312da-e4d7-4a07-ad55-873747d143fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:13:09.125201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:09.125891 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:09.127927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:09.135094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.135861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.143092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.143092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.152537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-75fbcc59-2fe2-41a8-9312-0e672f7791a5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:09.165698 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75fbcc59-2fe2-41a8-9312-0e672f7791a5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.166143 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75fbcc59-2fe2-41a8-9312-0e672f7791a5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.218136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:09.226575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-95a7447e-c8e9-41f6-8675-df1735db3575 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1306 microversion: 2.1 time: 0.105419 Jun 02 09:13:09.227303 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 154/309] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:09 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:09.229983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-75fbcc59-2fe2-41a8-9312-0e672f7791a5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Going to try to stop instance {{(pid=118038) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 09:13:09.358778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:09.359415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:09.365334 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.365783 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.366553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.366989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.448335 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-75fbcc59-2fe2-41a8-9312-0e672f7791a5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action" status: 202 len: 0 microversion: 2.1 time: 0.288760 Jun 02 09:13:09.448335 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 156/310] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:13:09 2022] POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 09:13:09.451173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:09.452555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:09.471594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.471594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.471594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:09.471594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:09.584391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:09.592287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:09.593827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:09.594971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-23d9a95d-a0f0-4ed9-9a8a-86b625da8129 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.240108 Jun 02 09:13:09.599367 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 155/311] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:09 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:09.650496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:09.659636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-faeecfbb-19d8-44ad-ab1f-94ba63bd1a46 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.215661 Jun 02 09:13:09.660299 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 157/312] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:09 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:10.243212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:10.243841 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:10.249976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.250423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.251189 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.251644 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.324563 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:10.334851 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5247adb2-4f14-4073-a081-230078695b2f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1306 microversion: 2.1 time: 0.095747 Jun 02 09:13:10.335441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 156/313] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:10 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:10.613776 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:10.615172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:10.621693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.622219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.623213 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.623664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.678967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:10.679607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:10.686456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.686908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.688246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:10.688954 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:10.801388 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:10.810708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:10.812513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:10.813870 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2c30e6f9-fabe-434f-83c3-1710cdaab868 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.204273 Jun 02 09:13:10.814420 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 158/314] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:10 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:10.856389 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:10.860806 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-afc5e19b-660c-4b5a-b987-b8ceca660c19 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.186301 Jun 02 09:13:10.861366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 157/315] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:10 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:11.352407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:11.353021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:11.366892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.376080 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.377050 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.377510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.441811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:11.450201 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2effda8a-a8af-409a-ae61-6074ab2d8043 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1306 microversion: 2.1 time: 0.102357 Jun 02 09:13:11.450771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:11 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:11.832848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:11.833467 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:11.839518 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.839970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.840734 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.841175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.878286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:11.878904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:11.886096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.886969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.888044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:11.888487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:11.891312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:12.146273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:12.152238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:12.153571 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:12.154726 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c04b7079-282d-4847-8dc2-e82d2b8d8db9 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.325725 Jun 02 09:13:12.155316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 158/317] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:11 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:12.166058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:12.166484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ecb1622e-281c-41d8-99a2-90ee157590f5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.291848 Jun 02 09:13:12.167119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 160/318] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:11 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:12.467940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:12.468803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:12.478671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:12.480295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=10 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:12.484066 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:12.484723 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:12.491173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:12.491173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:12.643569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:12.651911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e7103fa3-a260-4c95-ba2e-8ab10326fad0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.188725 Jun 02 09:13:12.652563 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 159/319] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:12 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:13.170751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:13.175082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:13.175728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:13.182729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.183108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.183899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.184254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:13.184690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.184869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:13.191719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.192173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.192946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.193382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.381466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:13.384475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:13.390011 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:13.391612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:13.392656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-96c9ee74-9592-4197-b718-4f85c6b1ea6d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.212597 Jun 02 09:13:13.400666 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-47eeb9fb-e1f5-4cdc-96cf-b4dac713328b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.223099 Jun 02 09:13:13.400787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 160/320] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:13 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:13.400879 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 161/321] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:13 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:13.668806 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:13.669435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:13.675511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.675982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.676738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:13.677168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:13.806675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:13.814105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3bf53e30-0d46-4ebc-8447-3b64a1120b18 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.149106 Jun 02 09:13:13.814684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 161/322] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:13 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:14.409696 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:14.410305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:14.410305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:14.410778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:14.416393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.416843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.416962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.417304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.417610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.418046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.418138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.418511 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.893700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:14.901647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-da175c3f-c08b-47d0-9e2c-fd76d26af4d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.495736 Jun 02 09:13:14.902399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 162/323] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:14 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:14.906786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:14.907423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:14.907988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:14.916680 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.916849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:14.923484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.923484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:14.923773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:14.923894 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:14.923977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-febbefd7-20c6-42a8-891e-687b6e1408d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.513662 Jun 02 09:13:14.923977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 162/324] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:14 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:15.172050 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:15.179570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-aaff7bb6-8567-4f49-a1e0-9626fc1c5f1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.276250 Jun 02 09:13:15.180479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 163/325] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:14 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:15.677500 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-c51bc6a1-6163-4ae5-a171-851ac53feacf req-5e8e6d61-a8f4-4560-8f6b-b81d2b7703e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:15.687326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c51bc6a1-6163-4ae5-a171-851ac53feacf req-5e8e6d61-a8f4-4560-8f6b-b81d2b7703e7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:15.687837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c51bc6a1-6163-4ae5-a171-851ac53feacf req-5e8e6d61-a8f4-4560-8f6b-b81d2b7703e7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:15.710723 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-c51bc6a1-6163-4ae5-a171-851ac53feacf req-5e8e6d61-a8f4-4560-8f6b-b81d2b7703e7 service nova] Creating event network-changed:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:13:15.722810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-c51bc6a1-6163-4ae5-a171-851ac53feacf req-5e8e6d61-a8f4-4560-8f6b-b81d2b7703e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050409 Jun 02 09:13:15.724330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 163/326] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:15.920353 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:15.921623 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:15.927823 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:15.928187 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:15.928957 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:15.929390 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:15.941412 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:15.942141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:15.948409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:15.948860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:15.951476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:15.951476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:16.120007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:16.127950 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-953bcebc-dc9d-4d36-9955-42650b361cc3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.211388 Jun 02 09:13:16.128705 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 164/327] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:15 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:16.131389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:16.139895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:16.141460 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:16.142538 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9c13739c-058d-4ddb-935c-3f594f20cb66 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.205454 Jun 02 09:13:16.143078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 164/328] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:15 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:16.197135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:16.197689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:16.203660 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:16.204101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:16.204897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:16.205328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:16.220386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=100 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:16.336671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:16.344048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f9cc3f72-404e-4945-9e5c-98a4f637e366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.150778 Jun 02 09:13:16.344611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 165/329] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:16 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:17.145743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:17.146356 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:17.152945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.153394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.154157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.154585 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.161785 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:17.162539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:17.168458 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.168905 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.169694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.170129 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.347683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:17.358526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-79265761-303f-4d14-8612-67cb76e704c9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.216381 Jun 02 09:13:17.359180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 165/330] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:17 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:17.359321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:17.367780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:17.367980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:17.368639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:17.369268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:17.370421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e4eb735f-d081-4a62-9395-08d30162b36a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.213091 Jun 02 09:13:17.370968 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 166/331] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:17 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:17.374793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.377863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.377863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:17.377863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:17.511570 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:17.521078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9c0acb87-ca56-4ff4-8706-a74830ced0c1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.159977 Jun 02 09:13:17.521946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 166/332] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:17 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:18.374549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:18.375271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:18.381415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.381861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.384166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.384606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.389129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:18.389873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:18.397388 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.398463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.399854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.400347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.690703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:18.699298 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-51c28409-4eaf-47b7-a9aa-a824b921ed38 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.328468 Jun 02 09:13:18.700114 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 167/333] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:18 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:18.703532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:18.707042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:18.708022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:18.713716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:18.714153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.714603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.715468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:18.715908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:18.716533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:18.717874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-877847be-d2fa-4bdd-941b-e89d9952619d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.333258 Jun 02 09:13:18.719063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 167/334] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:18 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:18.905948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:18.914783 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e3742827-cc47-4003-a373-ea90a14926dc tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.213051 Jun 02 09:13:18.915384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 168/335] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:18 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:19.717370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:19.717999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:19.725642 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:19.726692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:19.727756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:19.728524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:19.746833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:19.747743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:19.754295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:19.754811 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:19.755621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:19.759994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:19.990929 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:20.021670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-63148785-a5a5-497f-a8aa-d1b064fa6c59 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.293845 Jun 02 09:13:20.023540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 168/336] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:19 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:20.037452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:20.043161 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:20.048759 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:20.050460 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:20.053918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:20.060133 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-af3a0e2e-58e8-4b22-8248-b1715f29df95 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1742 microversion: 2.20 time: 0.316854 Jun 02 09:13:20.061001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 169/337] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:19 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1742 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:20.082980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:20.084006 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:20.085083 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:20.085525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:20.286906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:20.295295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0b2dc699-a0d2-4c68-bf58-ef6f04ee2c6a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.269336 Jun 02 09:13:20.296047 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:20 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:21.039747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:21.041084 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:21.056956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.057576 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.058520 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.058966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.085155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:21.086850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:21.103069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.107313 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.108656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.109315 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.353838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:21.361987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:21.362194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-aa4307c5-8ed7-49a6-8091-d748ab4dfecf tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.326374 Jun 02 09:13:21.362614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 170/339] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:21 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:21.367875 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:21.368472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:21.374228 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.374740 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.375719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:21.376151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:21.381020 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:21.382542 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:21.384181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ed59604b-2d16-45a2-b7b2-678ffbb0f603 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1742 microversion: 2.20 time: 0.304074 Jun 02 09:13:21.384739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 170/340] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:21 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1742 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:21.540598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:21.553305 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1bef9800-76fb-4551-bc82-7ba20f735db1 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.189330 Jun 02 09:13:21.554021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 171/341] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:21 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:22.380980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:22.383324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:22.396150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.397534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.399568 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.400856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.407734 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:22.408350 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:22.428948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.429721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.430532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.430965 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.719036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:22.740798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f40a734d-1408-4826-be94-7accb35c294b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.362898 Jun 02 09:13:22.742042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 171/342] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:22 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:22.759503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:22.760113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:22.772250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.772696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.773505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.774078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.803784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:22.815086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:22.820112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:22.823527 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-15fd6ac9-1c11-4357-a4ed-9b72587f0266 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1742 microversion: 2.20 time: 0.423873 Jun 02 09:13:22.832433 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 172/343] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:22 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1742 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:22.851465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-05be4c1c-8931-4f00-a9b3-0f430a9508b5 req-2e583358-bc60-48a4-99dc-7fd9fccaa8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "name": "network-vif-plugged", "status": "completed", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:22.894108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-05be4c1c-8931-4f00-a9b3-0f430a9508b5 req-2e583358-bc60-48a4-99dc-7fd9fccaa8db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:22.895047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-05be4c1c-8931-4f00-a9b3-0f430a9508b5 req-2e583358-bc60-48a4-99dc-7fd9fccaa8db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:22.951159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-05be4c1c-8931-4f00-a9b3-0f430a9508b5 req-2e583358-bc60-48a4-99dc-7fd9fccaa8db service nova] Creating event network-vif-plugged:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:13:22.967837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-05be4c1c-8931-4f00-a9b3-0f430a9508b5 req-2e583358-bc60-48a4-99dc-7fd9fccaa8db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133310 Jun 02 09:13:22.969271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 173/344] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:23.097861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:23.111629 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a79f760e-df8c-4f5f-8c3a-d40e290db484 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.366494 Jun 02 09:13:23.113043 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 172/345] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:22 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:23.762770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:23.765642 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:23.788679 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:23.789957 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:23.793209 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:23.794379 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:23.852234 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:23.853656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:23.860060 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:23.868668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:23.869368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:23.870326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:23.870916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:24.293645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:24.306040 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:24.314589 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:24.316181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-357b5f23-5797-479f-8840-9d947a9214f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.469250 Jun 02 09:13:24.316754 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 173/346] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:23 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:24.342305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:24.344452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:24.369251 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:24.381429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6e48ceee-b41b-4d28-8583-b3fac8eeb2e7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.624862 Jun 02 09:13:24.384136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:24.384691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:24.385959 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:24.397355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 174/347] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:23 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:24.397465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:24.659557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:24.669248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9e8d46a0-379a-401a-8e22-e2b69f8c67d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.350055 Jun 02 09:13:24.669888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 174/348] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:24 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:24.997113 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-71c8c79e-8330-455c-a80c-5c0c2c87d5a5 req-0534a48b-aa58-4a22-abab-b60e9f501b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "name": "network-vif-plugged", "status": "completed", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:25.035539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-71c8c79e-8330-455c-a80c-5c0c2c87d5a5 req-0534a48b-aa58-4a22-abab-b60e9f501b83 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.036427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-71c8c79e-8330-455c-a80c-5c0c2c87d5a5 req-0534a48b-aa58-4a22-abab-b60e9f501b83 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.052787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-71c8c79e-8330-455c-a80c-5c0c2c87d5a5 req-0534a48b-aa58-4a22-abab-b60e9f501b83 service nova] Creating event network-vif-plugged:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:13:25.061566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-71c8c79e-8330-455c-a80c-5c0c2c87d5a5 req-0534a48b-aa58-4a22-abab-b60e9f501b83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068318 Jun 02 09:13:25.063356 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 175/349] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:25.354334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:25.358511 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:25.373566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.377801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.379088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.379821 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.428357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:25.429326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:25.456886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.457296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.464107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.464721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.816636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:25.841180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:25.859467 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-79da2d51-514b-4419-8e6d-e03c7cbedc62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.458104 Jun 02 09:13:25.872918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 176/350] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:25 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:25.879593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:25.882149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:25.884370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:25.884624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:25.886347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7f8c3ce2-0ede-42b0-9e1e-ab008e9c0952 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.541463 Jun 02 09:13:25.886347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 175/351] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:25 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:25.939026 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.945514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:25.946745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:25.947407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:26.266593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:26.278663 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9c23d8c6-a7fa-45d4-bad4-6ea29c77ddb2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.404239 Jun 02 09:13:26.280224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 177/352] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:25 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:26.886066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:26.888329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:26.910024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:26.913070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:26.913909 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:26.920340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:26.921837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:26.927563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:26.929580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:26.930027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:26.930797 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:26.931221 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:27.321276 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:27.334226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:27.336013 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:27.339405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-37321f5e-48df-4dcb-aec3-67487d4bab43 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.433103 Jun 02 09:13:27.346081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 178/353] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:26 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:27.353687 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:27.356246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:27.373724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:27.374508 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:27.380092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:27.380975 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:27.396555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:27.407677 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-69f5736d-e090-453f-b3c2-aabc8396e119 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1726 microversion: 2.1 time: 0.530299 Jun 02 09:13:27.414985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 176/354] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:26 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1726 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:27.746742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:27.760626 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-033a3e09-4a6e-4b5d-8f22-b35187dadf1e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1372 microversion: 2.1 time: 0.413276 Jun 02 09:13:27.775750 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 179/355] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:27 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1372 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:28.372929 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:28.373584 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:28.383148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.383614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.393447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.394117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.409542 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:28.431745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:28.432332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:28.443613 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.445055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.448038 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.449788 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.742751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:28.751683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:28.753674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:28.755570 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5f23ecb7-3e86-476a-bf79-aa022a6ebc79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.386463 Jun 02 09:13:28.756742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 177/356] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:28 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:28.778122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:28.790819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:28.792253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:28.795281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5a71cdde-ecb1-43c3-8b8e-4a55857be2fd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1703 microversion: 2.1 time: 0.366596 Jun 02 09:13:28.801853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 180/357] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:28 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1703 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:28.802741 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.803199 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.808781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.808781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.820499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7ca24422-0c7a-48d1-a909-2d1930acb4ae tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:28.829312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7ca24422-0c7a-48d1-a909-2d1930acb4ae tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:28.829910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7ca24422-0c7a-48d1-a909-2d1930acb4ae tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:28.903964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7ca24422-0c7a-48d1-a909-2d1930acb4ae tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Going to try to start instance {{(pid=118037) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 09:13:29.028264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:29.037849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b945ecb3-eb09-41d3-b563-f1dcdf94c1ea tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1565 microversion: 2.1 time: 0.251719 Jun 02 09:13:29.039004 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 178/358] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:28 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1565 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:13:29.058641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:29.060319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:29.071127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.072065 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.073207 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.073945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.179044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e4ada06d-2749-4514-9d34-192fb092104a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125004 Jun 02 09:13:29.185367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 179/359] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:13:29 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:29.193771 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7ca24422-0c7a-48d1-a909-2d1930acb4ae tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action" status: 202 len: 0 microversion: 2.1 time: 0.377669 Jun 02 09:13:29.199551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 181/360] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:13:28 2022] POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 09:13:29.205973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:29.206598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:29.252514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.253305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.257885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.260608 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.642005 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:29.655013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-488a40d2-fade-43b2-91e3-98b20a0eb6a7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1712 microversion: 2.1 time: 0.453112 Jun 02 09:13:29.658410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 180/361] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:29 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1712 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:29.776757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:29.778143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:29.791884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.793679 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.796188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:29.799770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:29.840610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:30.287462 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:30.300146 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:30.306099 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:30.311750 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-25e439ec-2d91-4c3e-bb81-87312e7b55d0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.536307 Jun 02 09:13:30.325613 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 182/362] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:29 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:30.674325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:30.675437 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:30.698034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:30.703063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:30.706666 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:30.707360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:31.330120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:31.330758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:31.341901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:31.342360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:31.355798 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:31.356376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:31.690409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:31.699124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e506a840-da2f-4e2a-962d-28abf3a4ef71 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1712 microversion: 2.1 time: 1.028952 Jun 02 09:13:31.699915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 181/363] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:30 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1712 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:31.714000 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-057ed015-adda-4d71-9cf0-536feb3c1e69 req-5ee2e464-7842-4536-bfe3-0a28e96cbc6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:31.747428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-057ed015-adda-4d71-9cf0-536feb3c1e69 req-5ee2e464-7842-4536-bfe3-0a28e96cbc6a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:31.748149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-057ed015-adda-4d71-9cf0-536feb3c1e69 req-5ee2e464-7842-4536-bfe3-0a28e96cbc6a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:31.767396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-057ed015-adda-4d71-9cf0-536feb3c1e69 req-5ee2e464-7842-4536-bfe3-0a28e96cbc6a service nova] Creating event network-changed:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:13:31.777041 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-057ed015-adda-4d71-9cf0-536feb3c1e69 req-5ee2e464-7842-4536-bfe3-0a28e96cbc6a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070149 Jun 02 09:13:31.786132 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 182/364] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:31.881759 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:31.902994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:31.908243 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:31.909464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ddf5ce8b-69b7-42e6-a18b-6b0c7d65d5c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.583350 Jun 02 09:13:31.923104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 183/365] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:31 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:32.722325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:32.722325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:32.756173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:32.758694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:32.773296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:32.773296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:32.944756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:32.946137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:32.968544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:32.976542 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:32.981276 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:32.988016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:33.740569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:33.751929 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:33.755886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:33.757519 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-adfe46d1-7133-4bd4-9766-640613838096 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.832135 Jun 02 09:13:33.761051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 184/366] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:32 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:33.776413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:33.790848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-08d4d3a2-7f41-4e33-b959-938a49bece12 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1712 microversion: 2.1 time: 1.071492 Jun 02 09:13:33.791765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 183/367] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:32 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1712 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:34.779121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:34.788882 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:34.797732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:34.798465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:34.799546 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:34.800202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:34.819548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:34.819548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:34.826634 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:34.827190 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:34.828054 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:34.828499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:35.770659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:35.781106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2b3eb086-1ae9-447e-8efa-1f5f0b930fe9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1716 microversion: 2.1 time: 0.969514 Jun 02 09:13:35.784888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 184/368] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:13:34 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1716 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:13:35.824866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:35.833408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:35.838886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:35.849380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-75cd1c89-c3ba-47ff-bc2c-d43ff4cad61e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 1.073947 Jun 02 09:13:35.850143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 185/369] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:34 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:36.869248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:36.870627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:36.890302 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:36.891507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:36.892519 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:36.895802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:37.175542 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:37.191696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:37.193454 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:37.194903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fb9eb281-0a5b-42d4-8a51-b1144b911703 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.329563 Jun 02 09:13:37.204525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 185/370] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:36 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:38.268472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:38.269093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:38.291809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:38.292657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:38.293715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:38.295871 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:39.048836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:39.078737 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:39.080360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:39.093681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4ce714a1-3495-44ba-bddf-c7fce145d4bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.833598 Jun 02 09:13:39.105006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 186/371] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:38 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:40.110143 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:40.110804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:40.118135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:40.118608 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:40.119406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:40.119836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:40.262892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:40.269832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:40.271436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:40.272619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7b342d95-d653-4cb9-aad3-3213667d0b71 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.166528 Jun 02 09:13:40.273407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 186/372] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:40 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:41.291330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:41.291892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:41.310345 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=66 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:41.312540 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:41.317255 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:41.324531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:41.325247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:41.911058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:41.962726 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:41.973050 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:41.979595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-45888aeb-1978-49b4-96c4-cc080f13f539 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1737 microversion: 2.20 time: 0.687732 Jun 02 09:13:41.984550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 187/373] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:41 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1737 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:42.999413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:43.000698 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:43.025989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:43.029526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:43.030541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:43.030986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:43.528827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:43.539494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:43.541072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:43.542217 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-98bf815e-db3d-4bee-9dc4-1379f7dafb5f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1719 microversion: 2.20 time: 0.548002 Jun 02 09:13:43.542767 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 187/374] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:42 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1719 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:44.562016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:44.563219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:44.586968 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:44.588423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:44.591226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:44.593395 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:44.943476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:44.963331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:44.966575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:44.969566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e44dd6f1-1461-4e44-9bf2-6a77074871de tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1719 microversion: 2.20 time: 0.411990 Jun 02 09:13:44.985366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 188/375] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:44 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1719 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:45.993018 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:45.993629 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:46.004893 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:46.005344 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:46.006126 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:46.006559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:46.277971 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:46.291266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:46.292755 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:46.294664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a6fc3106-f638-468a-b26f-a5a8e066453f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1719 microversion: 2.20 time: 0.306031 Jun 02 09:13:46.305726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 188/376] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:45 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1719 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:46.944854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-d76f704b-ed10-4b90-8c28-cb9884e32e75 req-cfea846d-b497-4033-9c10-97d5459ed90a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "name": "network-vif-unplugged", "status": "completed", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:46.958141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-d76f704b-ed10-4b90-8c28-cb9884e32e75 req-cfea846d-b497-4033-9c10-97d5459ed90a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:46.958898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-d76f704b-ed10-4b90-8c28-cb9884e32e75 req-cfea846d-b497-4033-9c10-97d5459ed90a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:46.973238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-d76f704b-ed10-4b90-8c28-cb9884e32e75 req-cfea846d-b497-4033-9c10-97d5459ed90a service nova] Creating event network-vif-unplugged:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:13:46.980068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-d76f704b-ed10-4b90-8c28-cb9884e32e75 req-cfea846d-b497-4033-9c10-97d5459ed90a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041561 Jun 02 09:13:46.986766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 189/377] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:13:47.321517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:47.325836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:47.356679 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:47.359053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:47.364906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:47.365669 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:47.680139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:47.691782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:47.700555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:47.702421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7f91fefa-0b9d-4319-8d0a-a2f3486b45b6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1662 microversion: 2.20 time: 0.391990 Jun 02 09:13:47.703659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 189/378] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:47 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1662 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:47.721335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6208cd74-ba20-481f-8c59-a97ce43685c8"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:47.723138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:47.750413 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:47.753941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:47.754962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:47.759663 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:49.069414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6b2458d2-2629-41ac-b986-d5aba83031ee tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.352394 Jun 02 09:13:49.074855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 190/379] 10.222.0.18 () {62 vars in 1363 bytes} [Thu Jun 2 09:13:47 2022] POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments => generated 188 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:13:49.254829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:13:49.255526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:49.262915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:49.263461 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:49.264303 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:49.264942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:49.613313 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4755c463-705e-4db4-824c-2f91643b68d2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/action" status: 202 len: 0 microversion: 2.20 time: 0.362386 Jun 02 09:13:49.622085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:49.622738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:49.624674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 190/380] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 2 09:13:49 2022] POST /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:13:49.630402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:49.630860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:49.631681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:49.632112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:49.941293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:49.960325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:49.963484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:49.965488 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-51c35616-4d6b-48c4-bcec-95eec3400611 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1748 microversion: 2.20 time: 0.347301 Jun 02 09:13:49.980612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 191/381] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:49 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1748 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:50.996571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:50.997337 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:51.012599 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:51.013033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:51.013819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:51.014832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:51.333234 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:51.345839 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:51.350010 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:51.351470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e731d79e-e576-4f0a-8791-517fd102188d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1748 microversion: 2.20 time: 0.369966 Jun 02 09:13:51.357101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 191/382] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:50 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1748 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:52.373708 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:52.374380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:52.383252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:52.388368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:52.389273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:52.389724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:52.581268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:52.591431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:52.593224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:52.594777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7bf3b8b9-ca14-43a2-b040-440c9357a06e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1748 microversion: 2.20 time: 0.224836 Jun 02 09:13:52.595989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 192/383] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:52 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1748 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:13:53.614362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:53.614991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:53.632855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:53.633309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:53.634102 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:53.636927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:54.014392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:54.031981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:54.038968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:54.043049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-60ec1c7b-0bf5-4bfd-876a-af93329d2e85 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1750 microversion: 2.20 time: 0.430874 Jun 02 09:13:54.054085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 192/384] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:53 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1750 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:55.065333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:55.066178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:55.079319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:55.080064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:55.082879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:55.085081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:55.350323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:55.362879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:55.366531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:55.368078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8eba389a-51fe-4076-8678-f53941787ebb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.309130 Jun 02 09:13:55.381029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 193/385] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:55 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:56.389578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:56.390189 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:56.415920 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=42 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:56.464476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:56.467024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:56.467900 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:56.468349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:56.730113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:56.739638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:56.741136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:56.744889 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3c13be58-901b-4aa8-b49c-4476c1483e96 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.358863 Jun 02 09:13:56.745501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 193/386] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:56 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:57.766628 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:57.767358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:57.785763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:57.789728 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:57.792981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:57.794284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:58.085275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:58.113196 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:58.116886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:58.118404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8ce78361-8617-4ef6-ba8d-0be0b6bfe011 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.358303 Jun 02 09:13:58.133037 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 194/387] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:57 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:13:59.143435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:13:59.144731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:13:59.157219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:59.158253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:59.158938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:13:59.158938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:13:59.179838 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:13:59.433259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:59.444890 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:59.447149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:13:59.452047 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4b6ffe76-5922-4675-8131-b1d8c0fa3b72 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.313613 Jun 02 09:13:59.453113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 194/388] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:13:59 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:00.498415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:00.500098 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:00.518025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:00.519838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:00.521132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:00.521800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:00.536890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:00.801056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:00.826327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:00.828448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:00.829984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-91716e51-9187-4a57-8ae5-8a87170257a0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.355095 Jun 02 09:14:00.831674 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 195/389] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:00 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:01.094776 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-411447722", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:01.849180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:01.850401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:01.858698 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:01.862818 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:01.863876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:01.864768 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:02.074346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:02.083446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:02.094796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:02.096322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-88e1e88d-5478-4f92-8014-966b79ee9570 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.251534 Jun 02 09:14:02.098089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 196/390] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:01 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:03.118101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:03.118838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:03.131998 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:03.132794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:03.135794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:03.136549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:03.415814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:03.442073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:03.462317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:03.463313 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-fd834aa7-6220-46bb-88c3-a2f7627bfebc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.350521 Jun 02 09:14:03.464906 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 197/391] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:03 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:04.484870 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:04.486496 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:04.493914 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:04.494660 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:04.495537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:04.495978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:04.741716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:04.757384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:04.758802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:04.766810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-98fc035c-d6a0-4bb2-a4c9-6aa9044e2dc8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.279497 Jun 02 09:14:04.782972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 198/392] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:04 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:05.794331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:05.795093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:05.806787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:05.807745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:05.809030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:05.809753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:06.034763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:06.045642 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:06.047134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:06.050972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-15babf32-793f-4d25-b1c9-7e543423a26c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.268714 Jun 02 09:14:06.051932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 199/393] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:05 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:07.071310 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:07.072888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:07.083023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:07.085045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:07.088150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:07.090045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:07.293983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:07.308240 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:07.310657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:07.314039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a7072f19-5543-481e-a50b-c92749f24d93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.247305 Jun 02 09:14:07.327538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 200/394] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:07 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:08.339282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:08.340971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:08.348366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:08.352286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:08.352286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:08.352286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:08.594517 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:08.604990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:08.606780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:08.608154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dcb9d11f-3275-4606-82a2-80e71fb93876 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.274253 Jun 02 09:14:08.608812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 201/395] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:08 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:09.166843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d7dbad64-16b9-45db-a967-6e1ec024346e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'create', calling method: .version_select at 0x7f96703c9670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-975867841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOIxP9wfzrB2cw3QGUouxMsOVms+4ioa3VSHAMEFcMq+GIqK829eLaXRW15VB8PCKW3Wp3IwS7T0D00UtU0uxnYgA8ulc+ZCE8VuX52OY03Ke8EMlL6bm/nSyvL39sORQ=="}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:09.212769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d7dbad64-16b9-45db-a967-6e1ec024346e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Getting quotas for project eb2c902507914576a1d06ba54a87df1d. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:14:09.225475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d7dbad64-16b9-45db-a967-6e1ec024346e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Getting quotas for user 12293a5616e2410fb173a0b4424e63ff and project eb2c902507914576a1d06ba54a87df1d. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:14:09.241001 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] validate_networks() for None {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:14:09.366823 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d7dbad64-16b9-45db-a967-6e1ec024346e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.204105 Jun 02 09:14:09.368173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 202/396] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:14:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:09.486572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1582307984", "imageRef": "5879d6ad-13cb-4708-837a-bb306a483b35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-975867841", "networks": [{"uuid": "2665aa64-2d86-431c-8e57-b09ed1be4da6"}]}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:09.548390 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] validate_networks() for [('2665aa64-2d86-431c-8e57-b09ed1be4da6', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:14:09.864257 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:14:09.864670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:14:09.865257 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:14:09.865875 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:14:09.866275 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:14:09.875259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:09.875973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:09.876771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:09.877216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:09.895581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Getting quotas for project ca3cf0a7b9b0463cb4c0ef30736fa74d. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:14:09.899696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Getting quotas for user 3811f629778f4154a2e2eff9a58619c3 and project ca3cf0a7b9b0463cb4c0ef30736fa74d. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:14:09.911812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:14:09.914071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:14:10.030910 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8f23b8af-b1e3-4e36-9b47-31f32fc553cc tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.940912 Jun 02 09:14:10.032237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 195/397] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 8943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:14:10.043718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:10.044575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:10.059881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:10.060331 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:10.061116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:10.061547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:10.311637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:10.322889 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:10.324720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:10.326367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d4ab8e8b-a634-4e8f-8362-87b93b0fed69 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.292820 Jun 02 09:14:10.332803 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 196/398] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:10 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:10.341168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-78bf852e-1edf-4ed4-8dd0-0b965f4a573b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:10.341925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-78bf852e-1edf-4ed4-8dd0-0b965f4a573b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:10.357817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:14:10.358241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:14:10.358719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:14:10.359132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:14:10.359570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:14:10.369404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:10.369985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:10.370570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:10.371007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:10.388282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Getting quotas for project eb2c902507914576a1d06ba54a87df1d. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:14:10.392356 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Getting quotas for user 12293a5616e2410fb173a0b4424e63ff and project eb2c902507914576a1d06ba54a87df1d. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:14:10.397249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-78bf852e-1edf-4ed4-8dd0-0b965f4a573b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:10.403875 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:14:10.404189 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-78bf852e-1edf-4ed4-8dd0-0b965f4a573b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1214 microversion: 2.1 time: 0.072270 Jun 02 09:14:10.405771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 197/399] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:10 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:10.406124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5879d6ad-13cb-4708-837a-bb306a483b35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:14:10.565861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-60e11a49-8968-46f0-a68b-a9718c8138d1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083042 Jun 02 09:14:10.576943 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4523532f-1dd0-47d5-82a7-d931636e4290 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:10.577824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4523532f-1dd0-47d5-82a7-d931636e4290 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:10.579425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 203/400] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:14:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:14:10.675896 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4523532f-1dd0-47d5-82a7-d931636e4290 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:10.684130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4523532f-1dd0-47d5-82a7-d931636e4290 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1258 microversion: 2.1 time: 0.111095 Jun 02 09:14:10.685110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 198/401] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:10 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1258 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:11.345079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:11.346142 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:11.352570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:11.353018 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:11.353789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:11.354225 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:11.421950 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:11.422469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:11.429818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:11.430501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:11.431433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:11.431876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:11.505359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:11.513973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2e5b1b0f-1ece-48a6-8676-23a23145b536 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1218 microversion: 2.1 time: 0.095731 Jun 02 09:14:11.514562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 199/402] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:11 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:11.527476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:11.536153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:11.537727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:11.539587 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-284872cb-041f-43ed-8d89-ef9b0fcc6d77 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.198451 Jun 02 09:14:11.540493 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 204/403] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:11 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:11.700473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-21616ef4-6d6c-43dc-9d9f-9d73accdc6c4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:11.701045 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-21616ef4-6d6c-43dc-9d9f-9d73accdc6c4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:11.761639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-21616ef4-6d6c-43dc-9d9f-9d73accdc6c4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:11.768600 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-21616ef4-6d6c-43dc-9d9f-9d73accdc6c4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1258 microversion: 2.1 time: 0.072074 Jun 02 09:14:11.769154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 200/404] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:11 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:12.530763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:12.531350 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:12.533169 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:12.538007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.538444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.539198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.539670 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.558116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:12.558765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:12.566162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.566612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.567409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.567846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.600232 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:12.607554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-02d5a69b-b3e9-4a68-9b5a-b55f1cf46cac tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1266 microversion: 2.1 time: 0.080750 Jun 02 09:14:12.608109 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 205/405] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:12 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:12.703664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:12.713102 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:12.714581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:12.715749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e140e855-ddce-4d48-8445-440a6914932d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.161556 Jun 02 09:14:12.716300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 201/406] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:12 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:12.785037 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:12.785574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:12.791580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.792024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.792777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:12.793208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:12.854020 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:12.861392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7b1762b5-5432-413a-a1e8-3719d287bc58 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1310 microversion: 2.1 time: 0.080508 Jun 02 09:14:12.863554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 206/407] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:12 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:13.164621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-274675943", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "networks": [{"uuid": "ddf73512-4ae1-4e43-b5fb-0ba1c1fdcfe2"}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:13.217329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] validate_networks() for [('ddf73512-4ae1-4e43-b5fb-0ba1c1fdcfe2', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:14:13.626614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:13.627311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:13.633629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:13.634312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:13.635113 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:13.635593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:13.735915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:13.744459 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9ee77a7d-4fd1-4670-9aa6-7d76d63909b4 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1272 microversion: 2.1 time: 0.123792 Jun 02 09:14:13.745292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 207/408] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:13 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:13.750052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:13.750661 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:13.758562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:13.759014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:13.760008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:13.760445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.026417 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:14:14.026996 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:14:14.027705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:14:14.028115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:14:14.028525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:14:14.039768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.040216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.041321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.041909 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.061209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Getting quotas for project c5393c21cbc043318c9338c11264d29d. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:14:14.065854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Getting quotas for user dd2ce82718c341e8b1c321a2f128375d and project c5393c21cbc043318c9338c11264d29d. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:14:14.076460 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.078370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:14:14.081232 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:14:14.093184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.095257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.096509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-787c6d4d-071e-4c1f-805f-ed0920b7a629 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.350142 Jun 02 09:14:14.097132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 208/409] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:13 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:14.102492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:14.103417 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:14.112583 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.113703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.114563 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.115159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.234355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.245941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d5a1ef0e-9dc9-4044-9c80-b6d701d7b9b7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1316 microversion: 2.1 time: 0.147257 Jun 02 09:14:14.246874 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 209/410] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:14 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1316 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:14.255274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-258430c2-89bb-480d-8dbb-3891d76441ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095102 Jun 02 09:14:14.256603 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 202/411] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:14:14.268762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8d7d4b87-f7c3-4896-9434-c5dbff935443 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:14.269636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8d7d4b87-f7c3-4896-9434-c5dbff935443 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:14.405391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8d7d4b87-f7c3-4896-9434-c5dbff935443 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.412403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8d7d4b87-f7c3-4896-9434-c5dbff935443 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1218 microversion: 2.1 time: 0.147626 Jun 02 09:14:14.412958 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 210/412] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:14 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:14.762730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:14.764078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:14.771634 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.772448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.774108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:14.774758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:14.858031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:14.869101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f95af1c0-c83f-456b-b771-02e591052971 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1272 microversion: 2.1 time: 0.111031 Jun 02 09:14:14.870646 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 203/413] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:14 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:15.122962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:15.161534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:15.161534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.161534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.161534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.162369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.264812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:15.265433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:15.273977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.274695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.278260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.284243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.577979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:15.587865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:15.589438 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:15.590773 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-69086be2-7c85-4561-84fe-594d10cda3a6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.472041 Jun 02 09:14:15.603412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 211/414] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:15 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:15.606052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:15.608618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cb861ce1-0fc1-40bb-8225-ffb748cf56dd tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:15.609374 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cb861ce1-0fc1-40bb-8225-ffb748cf56dd tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:15.619413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f530d7db-7d45-4def-b0bb-40ec77d12076 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.358723 Jun 02 09:14:15.628324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 204/415] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:15 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:15.635039 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:15.635705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:15.647619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.647992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.648950 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:15.649588 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:15.845516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lazy-loading 'services' on Instance uuid b19073d8-fcec-4ea0-945a-c532266bf751 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:14:16.003922 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cb861ce1-0fc1-40bb-8225-ffb748cf56dd tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.014931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cb861ce1-0fc1-40bb-8225-ffb748cf56dd tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1218 microversion: 2.1 time: 0.410108 Jun 02 09:14:16.015578 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 212/416] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:15 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:16.021177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee1d1c24-c7f8-453e-9422-2d963c1fa1d6"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:16.022244 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:16.035590 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.036288 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.037239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.037673 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.199895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ace5ef51-bd5f-404b-ac14-7589a5282ab3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments/a2825270-6992-4219-8bdd-eb334c9d80c4" status: 202 len: 0 microversion: 2.1 time: 0.569737 Jun 02 09:14:16.200576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 205/417] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:14:15 2022] DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments/a2825270-6992-4219-8bdd-eb334c9d80c4 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:14:16.221042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:16.226330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:16.229524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.230264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.231517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.232180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.411501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.436137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c5891760-da6e-4087-a996-81761bf237e8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.234043 Jun 02 09:14:16.437596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 206/418] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:16 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:16.613889 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:16.614422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:16.623532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.624111 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.624899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.625338 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.772667 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.782935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.785430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.787078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0a66d72a-b1e7-4ed6-b34f-87e5793cd33f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.179901 Jun 02 09:14:16.798024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 207/419] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:16 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:16.801046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:16.801656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:16.807960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.808409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.809183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:16.809616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:16.944837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:16.952433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3e5bbdac-863d-4dd0-9b98-797a808de4a8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.155637 Jun 02 09:14:16.953026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 208/420] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:16 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:17.034033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:17.034762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:17.041787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.042503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.043404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.043946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.121863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:17.130045 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-efcc599c-dcb5-4592-819f-a70a4fac928d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.100278 Jun 02 09:14:17.141057 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 209/421] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:17 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:17.454234 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:17.454884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:17.461762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.462347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.463121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.463656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.612766 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:17.621306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ade93324-1ce4-4d7f-b4cc-e8a2adf948c1 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.171046 Jun 02 09:14:17.622179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 210/422] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:17 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:17.806127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:17.806779 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:17.813780 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.814352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.815133 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.815604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.963349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:17.973917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:17.975852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:17.977713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7687bcd1-a9e0-4011-a2bf-3194fdb9b12a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.175244 Jun 02 09:14:17.978410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 211/423] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:17 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:17.985429 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:17.992387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:17.995533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.995996 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:17.996872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:17.997314 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:18.140265 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:18.149809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5877cca8-62c7-4018-8bab-c5d07219c386 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.170304 Jun 02 09:14:18.159635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 212/424] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:17 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:18.159635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:18.159635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:18.164585 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:18.165107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:18.165977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:18.166472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:18.231226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:18.239844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-722e9d1c-9f7f-42dd-8953-eb5a0e9be2e9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.087928 Jun 02 09:14:18.240601 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 213/425] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:18 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:18.640636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:18.642268 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:18.649470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:18.649947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:18.650746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:18.651177 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:18.666728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:18.784368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:18.792424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-36257ff2-1570-45df-b242-377be5c762ba tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.157409 Jun 02 09:14:18.799721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 214/426] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:18 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:18.999594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:19.000439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:19.012640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.013196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.014826 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.015544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.162588 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.172141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.174524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.175725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6bbbb46c-1dc9-41d7-a24a-136b14f4f823 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.181216 Jun 02 09:14:19.176287 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 215/427] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:18 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:19.180792 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:19.181340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:19.187659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.188110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.188888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.189834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.332131 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.340576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1bb44d62-862e-4119-8f7f-1e5dc260991d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.163266 Jun 02 09:14:19.341404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 216/428] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:19 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:19.345910 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:19.346508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:19.352397 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.352842 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.353596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.354065 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.433230 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.441410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0f1f1247-3b7c-4553-88ce-8922e9851b45 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.098900 Jun 02 09:14:19.442148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 217/429] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:19 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:19.809514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:19.810233 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:19.817208 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.817653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.818425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:19.818853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:19.957772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:19.966720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9220bdaa-919e-4bed-b015-f293e39bcecf tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.161011 Jun 02 09:14:19.967644 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 218/430] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:19 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:20.193993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:20.194623 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:20.201463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.201904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.202671 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.203103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.346807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:20.355891 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:20.357390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:20.358557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d8040344-f44e-433e-87d7-99bf129f4900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.168549 Jun 02 09:14:20.369307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 219/431] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:20 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:20.381039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:20.384960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:20.388986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:20.393070 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.393526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.394304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.394736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.554822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:20.563118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-17623d34-84ec-4184-bfe2-3a3f6f176ead tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.202497 Jun 02 09:14:20.563726 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 220/432] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:20 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:20.573031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:20.573031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:20.578105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.578657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.579541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.580082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.646942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:20.655590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-45e45311-c710-4a10-943f-cc347fb4d2ae tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.089805 Jun 02 09:14:20.656416 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 221/433] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:20 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:20.985766 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:20.989820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:20.993067 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.993602 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:20.994557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:20.995075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.136173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.144404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c663b043-215b-4d6e-b71c-f70153b90ff7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.162683 Jun 02 09:14:21.144971 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 222/434] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:20 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:21.377881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:21.378626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:21.385513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.385964 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.386997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.387613 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.553552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.589062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.589062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.589062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5e03c7c1-2150-4652-a659-43aed679a605 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.194214 Jun 02 09:14:21.589326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 223/435] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:21 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:21.589326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:21.589326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:21.595323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.595849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.596685 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.597127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.742970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.762154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4b5dc0db-d18a-41ee-bc26-5f8e70216a08 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.173898 Jun 02 09:14:21.762154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 224/436] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:21 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:21.762154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:21.762154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:21.769006 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.769511 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.770293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:21.770787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:21.852136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:21.860021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e937fa53-f430-47ee-820f-1e8dbec64643 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.107582 Jun 02 09:14:21.861525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 225/437] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:21 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:22.161699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:22.162387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:22.164211 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:22.169129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.169576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:22.170346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.170778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:22.304224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:22.311689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bbabc56e-2cee-40e6-a4bf-18350af58471 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.154381 Jun 02 09:14:22.314946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 226/438] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:22 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:22.600285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:22.600887 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:22.607291 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.607736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:22.608490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.608915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:22.738648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:22.747194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:22.748699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:22.749902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-91dbb64e-b1c4-488c-9911-084933698e04 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.154259 Jun 02 09:14:22.750513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 227/439] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:22 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:22.769410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:22.770266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:22.776988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.777598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:22.778252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:22.778719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.035638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:23.043805 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fd8a37fc-9c59-4550-be24-f1eb91f70d16 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.279499 Jun 02 09:14:23.044387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 228/440] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:22 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:23.048754 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:23.049358 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:23.055640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.056088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.056859 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.057292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.143111 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:23.150511 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-58fd5b0d-fa85-4008-a4d4-b2ce8661f177 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1222 microversion: 2.1 time: 0.105078 Jun 02 09:14:23.151013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 229/441] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:23 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:23.327576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:23.328241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:23.334254 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.334733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.335564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.336006 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.609167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:23.621129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a371509f-36ef-43b7-ad5a-0c030a637807 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.297259 Jun 02 09:14:23.621727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 230/442] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:23 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:23.768473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:23.769100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:23.775504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.776073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.776906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:23.778323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:23.781651 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:24.051434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=4 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:24.072928 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=18 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:24.123174 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.131866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.133464 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.135288 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c5702b49-739c-4845-9d00-82e166673cd0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.371053 Jun 02 09:14:24.145489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 231/443] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:23 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:24.145489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:24.145489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:24.162672 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.163354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.164335 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.164925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.312029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-14bb1478-64cf-4af3-84a8-9fd9ee01d4e2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.294946 Jun 02 09:14:24.316977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 213/444] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:14:16 2022] POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments => generated 194 bytes in 8296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:24.318678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:24.319904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:24.328658 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.329321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.330753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.331370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.354500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:24.414574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.422080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-937ba7fa-f906-44de-8b00-4e15383ad77c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1270 microversion: 2.1 time: 0.108006 Jun 02 09:14:24.422803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 214/445] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:24 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:24.432699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.440382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-34bef9d7-c8c8-4c52-bcfc-31842e259d5e tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.302768 Jun 02 09:14:24.440934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 232/446] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:24 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:24.477778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-4050eb2b-a191-4c19-8d56-97b0811475aa req-f5c0dc5e-4934-46bd-9a04-615ed54c5d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:24.484412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-4050eb2b-a191-4c19-8d56-97b0811475aa req-f5c0dc5e-4934-46bd-9a04-615ed54c5d01 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.484939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-4050eb2b-a191-4c19-8d56-97b0811475aa req-f5c0dc5e-4934-46bd-9a04-615ed54c5d01 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.502038 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-4050eb2b-a191-4c19-8d56-97b0811475aa req-f5c0dc5e-4934-46bd-9a04-615ed54c5d01 service nova] Creating event network-changed:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:14:24.507410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-4050eb2b-a191-4c19-8d56-97b0811475aa req-f5c0dc5e-4934-46bd-9a04-615ed54c5d01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037756 Jun 02 09:14:24.508694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 215/447] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:24.639504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:24.640216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:24.655736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.656193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.657148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.657797 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.793287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6944bd91-c4e9-4cfe-8b85-ff29c7a821a3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:24.809075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6944bd91-c4e9-4cfe-8b85-ff29c7a821a3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:24.809529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6944bd91-c4e9-4cfe-8b85-ff29c7a821a3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:24.836664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6944bd91-c4e9-4cfe-8b85-ff29c7a821a3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Going to try to stop instance {{(pid=118037) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 09:14:24.964038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:24.973552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2052e8a9-cb96-4f35-bc40-ce1c5065e7f8 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.339183 Jun 02 09:14:24.974148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 233/448] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:24 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:25.094001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6944bd91-c4e9-4cfe-8b85-ff29c7a821a3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action" status: 202 len: 0 microversion: 2.1 time: 0.304963 Jun 02 09:14:25.094716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 216/449] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:14:24 2022] POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:14:25.103835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:25.104761 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:25.111952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.112651 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.113435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.114032 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.156691 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:25.157396 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:25.176873 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.177333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.178135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.178572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.468008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:25.473487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:25.491927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:25.494324 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:25.495913 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-545a68c7-5206-44a9-b75b-3dacf42b0639 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.343818 Jun 02 09:14:25.496087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c323f094-6f5b-4d48-99c7-dda619ea5c4e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.394444 Jun 02 09:14:25.497207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 217/450] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:25 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:25.502345 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:25.503309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:25.511024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 234/451] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:25 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:25.521258 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.521851 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.522738 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.524909 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:25.525487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.528751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:25.540904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.542077 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.543061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.546465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.905087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:25.913621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a7104e93-4be2-4de8-9fef-d57bbe533387 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1288 microversion: 2.1 time: 0.414966 Jun 02 09:14:25.914585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 218/452] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:25 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1288 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:25.990335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:25.991295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:25.997348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.997787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:25.998741 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:25.999357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.015322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=14 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:26.108846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.116722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d9796873-a453-40bc-8edb-cc2f71c1c0cd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.599728 Jun 02 09:14:26.126946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 235/453] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:25 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:26.271381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.278835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9c155341-2d42-4db5-a741-f05cde7da143 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.292387 Jun 02 09:14:26.279594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 219/454] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:25 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:26.409593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:14:26.409803 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:14:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:14:26.519717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:26.520428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:26.523495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-8ce1e92b-5e6b-4303-82b9-94c7e80c9c15 req-909b1865-f5b4-4840-8943-984e422ac568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be80386-9330-4daa-8bc1-439a2dc2caf2", "tag": "d1eb07ea-3118-494f-a4fc-944d6435586d"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:26.531176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.531786 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.532605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.533080 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.534178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8ce1e92b-5e6b-4303-82b9-94c7e80c9c15 req-909b1865-f5b4-4840-8943-984e422ac568 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.534848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8ce1e92b-5e6b-4303-82b9-94c7e80c9c15 req-909b1865-f5b4-4840-8943-984e422ac568 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.548915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-8ce1e92b-5e6b-4303-82b9-94c7e80c9c15 req-909b1865-f5b4-4840-8943-984e422ac568 service nova] Creating event network-changed:d1eb07ea-3118-494f-a4fc-944d6435586d for instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 on hv-cinder-82549 Jun 02 09:14:26.555140 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-8ce1e92b-5e6b-4303-82b9-94c7e80c9c15 req-909b1865-f5b4-4840-8943-984e422ac568 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035682 Jun 02 09:14:26.556387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 220/455] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:14:26.561091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:26.561814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:26.569236 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.569689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.570465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.570899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.759561 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.769601 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4588a362-d437-4781-bbe9-4ebfc60144ab tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.212318 Jun 02 09:14:26.770861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 221/456] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:26 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:26.775210 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.784087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.785594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:26.786755 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dcecea88-135f-4b2f-b3e4-93733d1ef3f8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.272585 Jun 02 09:14:26.787335 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 236/457] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:26 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:26.871088 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-67e310d3-3210-4f86-916c-d4f87d1a8d39 req-823decfe-fd80-47c6-baab-ac4b6f928697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "name": "network-vif-plugged", "status": "completed", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:26.879160 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-67e310d3-3210-4f86-916c-d4f87d1a8d39 req-823decfe-fd80-47c6-baab-ac4b6f928697 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.879644 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-67e310d3-3210-4f86-916c-d4f87d1a8d39 req-823decfe-fd80-47c6-baab-ac4b6f928697 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.893547 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-67e310d3-3210-4f86-916c-d4f87d1a8d39 req-823decfe-fd80-47c6-baab-ac4b6f928697 service nova] Creating event network-vif-plugged:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:14:26.898259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-67e310d3-3210-4f86-916c-d4f87d1a8d39 req-823decfe-fd80-47c6-baab-ac4b6f928697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Jun 02 09:14:26.898827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 222/458] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:26.932717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:26.933364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:26.940798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.941309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:26.942168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:26.942620 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.081716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:27.089068 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6d217845-7e52-4a64-b710-9b6a0e70bf80 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.161017 Jun 02 09:14:27.089625 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 237/459] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:26 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:27.134315 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:27.135035 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:27.141526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.141976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.142746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.143183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.277925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:27.285427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03d5c623-039f-4dbf-a07e-293778ed41a9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.155309 Jun 02 09:14:27.285987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 223/460] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:27 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:27.295587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:27.296202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:27.302742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.303195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.303994 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.304429 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.542644 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:27.556093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-beeaeaa0-02d6-4b72-a34f-ac7314e32fa7 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.263582 Jun 02 09:14:27.557237 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 238/461] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:27 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:27.789008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:27.789624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:27.795890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.796437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.797390 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.797912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.811708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:27.812284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:27.830280 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.836354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:27.837300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:27.837743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.077817 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.086842 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.088382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.089529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-15be5dec-0280-470a-b306-d16304903f60 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.287904 Jun 02 09:14:28.090088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 239/462] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:27 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:28.092637 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.094858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-cc3ae985-5b0c-42d8-be5e-6016e66ca445 req-3112b901-eba5-4e95-93d0-8b9a848f16f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdbdb543-4fcc-4700-870a-38456b5e9b2a", "tag": "bbabefb0-201d-40ce-afcc-af32fc80d6af"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:28.103227 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c29fc304-c4b9-42c9-8a08-57b3b24f4af9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.318530 Jun 02 09:14:28.104144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 224/463] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:27 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:28.108308 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:28.108450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-cc3ae985-5b0c-42d8-be5e-6016e66ca445 req-3112b901-eba5-4e95-93d0-8b9a848f16f1 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.111038 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-cc3ae985-5b0c-42d8-be5e-6016e66ca445 req-3112b901-eba5-4e95-93d0-8b9a848f16f1 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.111158 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:28.119278 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.119278 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.119278 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.119278 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.119844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-cc3ae985-5b0c-42d8-be5e-6016e66ca445 req-3112b901-eba5-4e95-93d0-8b9a848f16f1 service nova] Creating event network-changed:bbabefb0-201d-40ce-afcc-af32fc80d6af for instance bdbdb543-4fcc-4700-870a-38456b5e9b2a on hv-cinder-82549 Jun 02 09:14:28.124855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-cc3ae985-5b0c-42d8-be5e-6016e66ca445 req-3112b901-eba5-4e95-93d0-8b9a848f16f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033600 Jun 02 09:14:28.125451 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 240/464] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:28.250169 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.258451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c7042e72-f1a0-4648-8e9f-53904ab0e418 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.153622 Jun 02 09:14:28.259019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 225/465] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:28 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:28.301799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:28.302506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:28.308765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.309214 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.309987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.310424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.440691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.448152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3e9ab16b-7eda-4683-9524-e947edbedc75 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.150593 Jun 02 09:14:28.448716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 241/466] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:28 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:28.572945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:28.573648 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:28.579743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.580219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.580979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:28.581410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:28.710151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:28.717456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d59ec898-c133-46eb-b9a7-a42988d17f07 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.148263 Jun 02 09:14:28.718008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 226/467] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:28 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:29.110072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:29.111800 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:29.118750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.119224 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.120209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.122447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.128879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:29.129618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:29.142305 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.142898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.144652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.145192 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.427082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.431849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.435916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.437541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.438683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-470ccb56-985d-42b0-bfa4-415f3525f6ed tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.332666 Jun 02 09:14:29.439282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 242/468] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:29 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:29.439624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a7a18fd9-dec9-4f59-a599-3d5ae03bb8b1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.316113 Jun 02 09:14:29.440171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 227/469] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:29 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:29.443968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:29.444566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:29.451285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.451285 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.451654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.452089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.465048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:29.465661 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:29.472253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.472699 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.473464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.473901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.644494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.652059 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-db12d761-5f3e-411f-b6f6-2fdc4a4c2793 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.211772 Jun 02 09:14:29.653214 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 243/470] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:29 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:29.655483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.663423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f9a443e2-42d0-481c-af22-0ea516650cf0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.202047 Jun 02 09:14:29.664380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 228/471] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:29 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:29.733770 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:29.734305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:29.740384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.740831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.741591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:29.742024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:29.870494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:29.878228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-43defda0-6f0a-433e-8dd1-18d9c053866c tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.148307 Jun 02 09:14:29.878783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 244/472] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:29 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:30.458706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:30.459398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:30.462271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:30.463153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:30.466501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.466966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.468049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.468564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.471847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.472398 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.473307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.473946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.672949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.677019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.682871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.684702 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.685789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-25a67540-23a3-4de7-b537-6065f5645b91 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.227636 Jun 02 09:14:30.686603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 229/473] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:30 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:30.686888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4704184f-9235-4486-82ff-3b273c58ef26 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.233424 Jun 02 09:14:30.688487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 245/474] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:30 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:30.692358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:30.693081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:30.694014 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:30.694911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:30.703831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.703831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.703831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.703831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.705007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.705610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.706588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.707172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.916296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.935133 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:30.937409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-46ba1309-7b33-4d9c-84fc-4077bfedab72 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.247095 Jun 02 09:14:30.937998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 246/475] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:30 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:30.944463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:30.945383 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:30.946838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f85dba2f-cd6e-412f-b042-9afb4f9599c1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.257582 Jun 02 09:14:30.947692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 230/476] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:30 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:30.953562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.955846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:30.955846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:30.956033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.019929 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-accb104f-32ff-4e5f-ac4d-6041579ce98c req-ae50a9ef-0c1d-4042-a21d-17a8e2959080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be80386-9330-4daa-8bc1-439a2dc2caf2", "name": "network-vif-plugged", "status": "completed", "tag": "d1eb07ea-3118-494f-a4fc-944d6435586d"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:31.028172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-accb104f-32ff-4e5f-ac4d-6041579ce98c req-ae50a9ef-0c1d-4042-a21d-17a8e2959080 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.028609 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-accb104f-32ff-4e5f-ac4d-6041579ce98c req-ae50a9ef-0c1d-4042-a21d-17a8e2959080 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.040593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-accb104f-32ff-4e5f-ac4d-6041579ce98c req-ae50a9ef-0c1d-4042-a21d-17a8e2959080 service nova] Creating event network-vif-plugged:d1eb07ea-3118-494f-a4fc-944d6435586d for instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 on hv-cinder-82549 Jun 02 09:14:31.045711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-accb104f-32ff-4e5f-ac4d-6041579ce98c req-ae50a9ef-0c1d-4042-a21d-17a8e2959080 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031332 Jun 02 09:14:31.046804 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 231/477] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:31.098281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:31.106937 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f2633618-9aab-4baa-a3dd-26a97752a269 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.166468 Jun 02 09:14:31.107653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 247/478] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:30 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:31.705194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:31.705912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:31.706151 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:31.706886 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:31.712598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.713048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.713833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.713938 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.714272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.714499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.715351 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.715786 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.730101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:31.730649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:31.918952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:31.922562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:31.928452 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-54b56e6b-9419-4196-94f6-52150fe2e409 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.228386 Jun 02 09:14:31.929164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 232/479] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:31 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:31.932091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:31.933903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:31.935075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6526ff9b-b532-4366-86b5-c72159ebdd2f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1806 microversion: 2.20 time: 0.233258 Jun 02 09:14:31.935640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 248/480] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:31 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:14:31.953453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:31.954056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:31.960069 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.960511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.961270 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.961699 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.964371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:31.964969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:31.971295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.971736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:31.972494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:31.972921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.158245 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:32.162740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:32.165934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b93206d9-a850-4b79-826a-f07b7622a47f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.216073 Jun 02 09:14:32.166521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 233/481] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:31 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:32.171122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ec268ab5-1c6e-48c0-b9ee-855958fa2aaf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.210422 Jun 02 09:14:32.178023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 249/482] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:31 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:32.178149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:32.178149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:32.181595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.182040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.182817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.183272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.316809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:32.324170 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f0151610-d393-46e6-9d6a-0bd3c64dec6b tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.156379 Jun 02 09:14:32.324659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 234/483] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:32 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:32.945858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:32.946480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:32.953034 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:32.953779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:32.955018 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.955848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.956751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.957370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.961219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.961677 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:32.962612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:32.963048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.198071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.206907 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.208667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.209853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d20857fd-ec4d-47f6-bea1-c74fba9277ea tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1793 microversion: 2.20 time: 0.260600 Jun 02 09:14:33.210565 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 235/484] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:14:32 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1793 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:14:33.214996 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.215372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-f7bf1579-8386-4f92-b11b-69c940ce5586 req-c704593c-50ca-4c86-af8a-7ad268f4cfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "name": "network-vif-plugged", "status": "completed", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:33.223139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-da4e557b-d1b6-44d5-9a80-52d2b164c71a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.281265 Jun 02 09:14:33.223550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-f7bf1579-8386-4f92-b11b-69c940ce5586 req-c704593c-50ca-4c86-af8a-7ad268f4cfd7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.223990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-f7bf1579-8386-4f92-b11b-69c940ce5586 req-c704593c-50ca-4c86-af8a-7ad268f4cfd7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.224668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 250/485] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:32 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:33.230227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:33.231128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:33.236598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-f7bf1579-8386-4f92-b11b-69c940ce5586 req-c704593c-50ca-4c86-af8a-7ad268f4cfd7 service nova] Creating event network-vif-plugged:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:14:33.237998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.238516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.239392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.239899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.242344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-f7bf1579-8386-4f92-b11b-69c940ce5586 req-c704593c-50ca-4c86-af8a-7ad268f4cfd7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 Jun 02 09:14:33.242929 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 236/486] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:33.248730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:33.249420 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:33.256501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.257062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.257838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.258268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.456775 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.461061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.469071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-75cd6f87-4513-4278-87f2-75d74a14d55c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.243128 Jun 02 09:14:33.469654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 251/487] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:33 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:33.470588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e83c5346-ac69-47cc-be12-eca2078da038 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.225669 Jun 02 09:14:33.475453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:33.476291 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:33.480537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 237/488] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:33 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:33.482555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.483062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.483926 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.484423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.613559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:33.625294 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b5907703-46d9-479d-ac21-af445481bf3a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.150063 Jun 02 09:14:33.625294 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 252/489] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:33 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:33.975422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:33.976412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:33.982810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.983453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:33.984050 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:33.984476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.005985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'flavor' on Instance uuid 19e5281e-07b3-4b55-8fb8-987b3ee1e875 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:14:34.246605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:34.247325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:34.256093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.256566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.257376 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.257808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.334890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-55cc5dec-0c07-4ebb-80e7-32e67a61a7c0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/action" status: 200 len: 32 microversion: 2.1 time: 0.363303 Jun 02 09:14:34.335697 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 238/490] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:14:33 2022] POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:14:34.346435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:34.347134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:34.353386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.353831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.354611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.355033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.389242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:34.397976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-82cc60be-309a-46f8-8878-14e54219392b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.155105 Jun 02 09:14:34.398547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 253/491] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:34 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:34.486557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:34.487908 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:34.488522 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:34.494591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.494811 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a4e51e90-f05b-4f75-b5f5-eb92c6a5740f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.152402 Jun 02 09:14:34.495035 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.495428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 239/492] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:34 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:34.495833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.496339 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.508565 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:34.509172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:34.515412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.515864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.516631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.517092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.682072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:34.690379 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-58aefd93-60a3-43d0-8530-8fc4eeecad5f tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.207029 Jun 02 09:14:34.694967 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 254/493] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:34 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:34.695565 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:34.696539 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:34.699850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:34.703356 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.704043 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.705023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:34.705659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:34.715352 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b0aa5041-3646-4527-bb22-d385203c9574 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.218799 Jun 02 09:14:34.716085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 240/494] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:34 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:34.840368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:34.848983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-265dea8d-4850-4647-97b5-debfabc4a9dd tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1314 microversion: 2.1 time: 0.156950 Jun 02 09:14:34.849467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 255/495] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:34 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:35.257053 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-bd68c9df-8315-4ad0-aaad-d37d773ac98c req-030cb3df-cfc7-4369-a6fa-c6bdeef1cae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbdb543-4fcc-4700-870a-38456b5e9b2a", "name": "network-vif-plugged", "status": "completed", "tag": "bbabefb0-201d-40ce-afcc-af32fc80d6af"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:35.265808 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-bd68c9df-8315-4ad0-aaad-d37d773ac98c req-030cb3df-cfc7-4369-a6fa-c6bdeef1cae0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.266246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-bd68c9df-8315-4ad0-aaad-d37d773ac98c req-030cb3df-cfc7-4369-a6fa-c6bdeef1cae0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.277554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-bd68c9df-8315-4ad0-aaad-d37d773ac98c req-030cb3df-cfc7-4369-a6fa-c6bdeef1cae0 service nova] Creating event network-vif-plugged:bbabefb0-201d-40ce-afcc-af32fc80d6af for instance bdbdb543-4fcc-4700-870a-38456b5e9b2a on hv-cinder-82549 Jun 02 09:14:35.282176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-bd68c9df-8315-4ad0-aaad-d37d773ac98c req-030cb3df-cfc7-4369-a6fa-c6bdeef1cae0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028749 Jun 02 09:14:35.283358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 241/496] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:35.415641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:35.416276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:35.422919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.423394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.424156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.424703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.513135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:35.513859 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:35.520484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.520936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.521703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.522137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.553974 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:35.561557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2dbff398-da8e-4697-a562-12d662e1d9e4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1680 microversion: 2.1 time: 0.149803 Jun 02 09:14:35.562134 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 256/497] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:35 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:35.707723 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:35.708348 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:35.714819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.715305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.716087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.716526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.971443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:35.980449 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bd7e45bf-dc35-49bb-bbca-ca7178850d3a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.471593 Jun 02 09:14:35.987378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 242/498] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:35 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:35.987378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:35.987378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:35.993176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.993631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:35.994405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:35.994836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.045103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:36.053007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-da57337e-5921-4062-9c4b-4a7163c3adb3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1358 microversion: 2.1 time: 0.349962 Jun 02 09:14:36.053750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 257/499] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:35 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:36.057873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:36.058480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:36.065218 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.065662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.066483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.066946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.214083 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:36.221566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e6075125-a328-48dd-bbe5-90c7b3309d63 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.239526 Jun 02 09:14:36.222377 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 243/500] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:35 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:36.295450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:36.303532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-42515b41-5284-4e19-9010-a514c141f8a3 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1463 microversion: 2.1 time: 0.248940 Jun 02 09:14:36.304095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 258/501] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:36 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:36.341724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:36.342321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:36.349243 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.349690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.350481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.350915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.376113 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:14:36.578690 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:36.579424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:36.585791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.586235 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.586990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.587447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.635396 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-59e5b4e0-6b39-4303-8e41-5c8faa842b31 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 204 len: 0 microversion: 2.1 time: 0.296907 Jun 02 09:14:36.636264 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 244/502] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:14:36 2022] DELETE /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:14:36.644671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:36.645534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:36.651808 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.652252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.653134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.654110 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.830046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:36.837881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ea59278c-7057-4329-8827-a2c53bfe669b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1657 microversion: 2.1 time: 0.263036 Jun 02 09:14:36.838549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 259/503] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:36 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1657 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:36.851604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:36.854696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e048352d-e414-4fc3-ba52-e9ab20ebd865 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:36.859272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ba574ab9-e3d2-4d8f-9b72-e16fedfca25a tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1469 microversion: 2.1 time: 0.218613 Jun 02 09:14:36.859861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 245/504] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:36 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:36.860783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e048352d-e414-4fc3-ba52-e9ab20ebd865 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:36.861226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e048352d-e414-4fc3-ba52-e9ab20ebd865 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:36.883712 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e048352d-e414-4fc3-ba52-e9ab20ebd865 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Going to try to start instance {{(pid=118038) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 09:14:36.997833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:36.998434 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.004546 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.005036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.005934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.006413 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.057810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e048352d-e414-4fc3-ba52-e9ab20ebd865 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action" status: 202 len: 0 microversion: 2.1 time: 0.206575 Jun 02 09:14:37.058475 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 260/505] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:14:36 2022] POST /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 09:14:37.068626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.069425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.075755 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.076206 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.076989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.077426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.185985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.188324 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:37.195328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3c28c50d-41c4-4a49-bdf7-65dc8c66d25d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.201325 Jun 02 09:14:37.195893 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 246/506] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:36 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:37.200226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.200824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.207111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.207583 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.208351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.208785 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.231812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.239691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-87bfb16e-471c-4471-a2a4-f6e1bbf6daa9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1666 microversion: 2.1 time: 0.176854 Jun 02 09:14:37.240263 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 261/507] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1666 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:37.244604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.246916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.251592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.252043 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.252810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.253242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.396747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.404253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c04f20f6-ca26-4406-a7a7-b2262df61a1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1549 microversion: 2.1 time: 0.207411 Jun 02 09:14:37.404824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 247/508] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1549 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:37.420912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.421526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.423935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.428058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.428492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.429259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.429695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.431561 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-868c3abc-ffcf-4923-9f8b-c4fa0fdb058f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.190336 Jun 02 09:14:37.432157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 262/509] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:37.558412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.565750 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c314a689-48d6-4a69-98ef-58135f996814 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1549 microversion: 2.1 time: 0.148590 Jun 02 09:14:37.566306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 248/510] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:37.586748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.590252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.590999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Searching by: {'deleted': False, 'project_id': 'eb2c902507914576a1d06ba54a87df1d'} {{(pid=118038) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 09:14:37.600057 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.600483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.601269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.601697 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.687570 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.multi_cell_list [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118038) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 09:14:37.740165 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:37.781094 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-01610c66-aed9-4134-8902-605d40c6c26c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198124 Jun 02 09:14:37.781664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 263/511] 10.222.0.18 () {58 vars in 1124 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:14:37.792226 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.792839 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.798770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.799219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.800018 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.800456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.877117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:37.877117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:37.883856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.884499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.890534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:37.890534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:37.938978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:37.946878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5cd93350-4ab4-4f69-9f87-e749214e72ec tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1549 microversion: 2.1 time: 0.158433 Jun 02 09:14:37.947549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 249/512] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:38.025682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:38.033252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-35804ef0-9e07-4e0e-81f9-9e3a93b11869 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1469 microversion: 2.1 time: 0.161049 Jun 02 09:14:38.034049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 264/513] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:37 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:38.212372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:38.212899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:38.214869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:38.219710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.220201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.220961 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.221429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.263171 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:38.264113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:38.270445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.270973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.271849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.272343 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.464700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:38.468771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:38.473357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-049b5fe5-c773-402f-87d2-9f2812d902da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.264817 Jun 02 09:14:38.473933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 250/514] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:38 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:38.478409 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:38.479012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:38.484760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.485753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.485918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-24953996-9fc6-4d75-9007-face62c21a06 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1666 microversion: 2.1 time: 0.226185 Jun 02 09:14:38.486514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 265/515] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:38 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1666 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:38.486700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:38.487104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:38.629375 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:38.637332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8a9e372d-2ce9-49f7-b49e-6800ce872dce tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1318 microversion: 2.1 time: 0.162433 Jun 02 09:14:38.637906 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 251/516] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:38 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:39.049914 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:39.050440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:39.056836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.057276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.058030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.058455 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.251251 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:39.259712 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fc21e956-59ee-45da-8b5c-f6d8a1774cb5 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1469 microversion: 2.1 time: 0.213574 Jun 02 09:14:39.260581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 266/517] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:39 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:39.489888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:39.490488 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:39.496920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.497869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.498639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.499070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.503069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:39.503727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:39.509768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.510217 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.510981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.511695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.714868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:39.723946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-45d7a965-8f20-4d52-bfa8-b4b198660962 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.237828 Jun 02 09:14:39.724634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 252/518] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:39 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:39.731330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:39.732095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:39.754524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.755266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.756441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.757210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.805013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:39.819622 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d268bcfd-3c22-48e8-888e-513bc650b738 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1666 microversion: 2.1 time: 0.320708 Jun 02 09:14:39.820282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 267/519] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:39 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1666 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:39.890145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:39.891484 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:39.897784 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.898413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:39.899524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:39.900167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.047104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:40.071796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-708c00f1-5232-4298-aed7-e0416eb67e06 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1508 microversion: 2.1 time: 0.344650 Jun 02 09:14:40.074577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 253/520] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:39 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:40.277551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:40.278098 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:40.284787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.285239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.286019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.286451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.363454 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:40.374370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5cb00c8a-2431-43c3-b81e-336c1bd0593d tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1427 microversion: 2.1 time: 0.100533 Jun 02 09:14:40.375571 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 254/521] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:40 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:40.489280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-52a51d67-9590-4b14-9323-c943099882bc req-dd512cb3-b012-4f0b-bb67-9e1a0f03083c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be80386-9330-4daa-8bc1-439a2dc2caf2", "name": "network-vif-deleted", "tag": "d1eb07ea-3118-494f-a4fc-944d6435586d"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:40.500781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-52a51d67-9590-4b14-9323-c943099882bc req-dd512cb3-b012-4f0b-bb67-9e1a0f03083c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.501423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-52a51d67-9590-4b14-9323-c943099882bc req-dd512cb3-b012-4f0b-bb67-9e1a0f03083c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.513558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-52a51d67-9590-4b14-9323-c943099882bc req-dd512cb3-b012-4f0b-bb67-9e1a0f03083c service nova] Creating event network-vif-deleted:d1eb07ea-3118-494f-a4fc-944d6435586d for instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 on hv-cinder-82549 Jun 02 09:14:40.519306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-52a51d67-9590-4b14-9323-c943099882bc req-dd512cb3-b012-4f0b-bb67-9e1a0f03083c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Jun 02 09:14:40.522855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 255/522] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:14:40.741508 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:40.742216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:40.748420 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.748872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.749643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.750080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.900652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:40.909556 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f0e78c81-da23-476e-9c3a-25547763f5d3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.172121 Jun 02 09:14:40.910136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 256/523] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:40 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:40.915733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:40.916342 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:40.929729 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.930183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:40.931004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:40.931472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:41.048366 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f32aaa9f-a3d6-4820-8413-1736aa17d585 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162221 Jun 02 09:14:41.049276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 268/524] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:14:39 2022] POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:14:41.073211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:41.081378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3324226e-51dc-4791-bcee-ae553d2ade23 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1666 microversion: 2.1 time: 0.170234 Jun 02 09:14:41.082027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 257/525] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:40 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1666 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:41.391992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:41.392692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:41.399116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:41.399611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:41.400382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:41.400848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:41.431529 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:41.431982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:41.432428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lazy-loading 'fault' on Instance uuid 6be80386-9330-4daa-8bc1-439a2dc2caf2 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:14:41.477007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3811f629778f4154a2e2eff9a58619c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca3cf0a7b9b0463cb4c0ef30736fa74d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:41.484404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2fc51559-5825-4d55-96e4-e5b3571d2441 tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 200 len: 1304 microversion: 2.1 time: 0.096677 Jun 02 09:14:41.484944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 269/526] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:41 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:41.929116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:41.930064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:41.943565 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:41.944027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:41.945087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:41.945651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:42.079062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:42.087295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03884321-8349-49ef-ba92-5f29774d5366 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.162131 Jun 02 09:14:42.092862 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 258/527] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:41 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:42.097936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:42.098601 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:42.104653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:42.105100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:42.105861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:42.106300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:42.253068 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:42.260688 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dc9e2824-068b-4e4d-898e-bd90d893b962 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1670 microversion: 2.1 time: 0.166713 Jun 02 09:14:42.263981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 270/528] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:42 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:42.501600 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:42.502131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] [instance: 6be80386-9330-4daa-8bc1-439a2dc2caf2] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:42.508236 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:42.508674 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:42.510702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:42.510702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:42.523244 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] HTTP exception thrown: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Request method failure captured: Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 HTTP/1.1 Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH9VKtC_PJyAVXZy8Ft99yEwMoHwT08_FQi6UEg-Z29I7XRklIMthikw9nhnBLQv7a2Zgn3c77FWn_O2vzgVytt2P7tTuEM_Q7eA7OpX_Pw85lspNJmlMa6HzDQod2ojPNlNfD0cCgbTJE-qHiwpUWp5ih6YbMwc49Sy5nMeCFtJebc Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: ca3cf0a7b9b0463cb4c0ef30736fa74d Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-VolumesNegativeTest-272593208 Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:14:42.524869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca3cf0a7b9b0463cb4c0ef30736fa74d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca3cf0a7b9b0463cb4c0ef30736fa74d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ca3cf0a7b9b0463cb4c0ef30736fa74d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ca3cf0a7b9b0463cb4c0ef30736fa74d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-VolumesNegativeTest-272593208 Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: ca3cf0a7b9b0463cb4c0ef30736fa74d Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-VolumesNegativeTest-272593208 Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-VolumesNegativeTest-272593208-project Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 3811f629778f4154a2e2eff9a58619c3 Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-VolumesNegativeTest-272593208-project Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. Jun 02 09:14:42.526439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '6be80386-9330-4daa-8bc1-439a2dc2caf2'} Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:14:42.527401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. Jun 02 09:14:42.529182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:14:42.530575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] Returning 404 to user: Instance 6be80386-9330-4daa-8bc1-439a2dc2caf2 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:14:42.530575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dc730cb5-2c98-46a8-9eb6-8a34752f0eed tempest-VolumesNegativeTest-272593208 tempest-VolumesNegativeTest-272593208-project] 10.222.0.18 "GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2" status: 404 len: 111 microversion: 2.1 time: 0.028836 Jun 02 09:14:42.530575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 259/529] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:42 2022] GET /compute/v2.1/servers/6be80386-9330-4daa-8bc1-439a2dc2caf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:14:43.104796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:43.105407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:43.113759 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:43.115087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:43.116012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:43.116456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:43.299884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:43.308099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-dc384eee-f6a6-4a99-ad22-3b27b16af4a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.207214 Jun 02 09:14:43.308916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 271/530] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:43 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:44.325621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:44.326191 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:44.333402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:44.333856 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:44.334632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:44.335068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:44.465900 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:44.475883 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ee3125ac-7ace-4c8f-9f5e-062ab5780ce4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.154326 Jun 02 09:14:44.476772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 260/531] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:44 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:45.493778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:45.494389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:45.502238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:45.502238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:45.503013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:45.503474 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:45.651738 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:45.659843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-67670b78-8d63-4cce-8355-57b7745bbd76 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.169838 Jun 02 09:14:45.660552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 272/532] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:45 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:46.679208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:46.679927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:46.686446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:46.686901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:46.687704 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:46.688214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:46.823164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:46.831761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b6a7f9d9-0ac9-4464-852c-ee3a44a7331b tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.156918 Jun 02 09:14:46.832307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 261/533] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:46 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:47.848576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:47.849186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:47.851730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:47.856502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:47.856950 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:47.857712 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:47.858147 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:48.001023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:48.009885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8b880a59-b876-4c30-b7fb-22357522914e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.165033 Jun 02 09:14:48.010450 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 273/534] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:47 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:49.027308 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:49.027910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:49.036011 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:49.036453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:49.037317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:49.037746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:49.177073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:49.185329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-40b49957-070b-40b5-abdf-fa9247a5762e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.162702 Jun 02 09:14:49.185831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 262/535] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:49 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:50.202465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:50.203093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:50.212750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:50.213206 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:50.213984 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:50.214424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:50.341249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:50.351295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-95005796-ad73-402f-a6a9-88e4235b6d4a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.152413 Jun 02 09:14:50.351981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 274/536] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:50 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:50.720337 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:50.721022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:50.727507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:50.727947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:50.728704 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:50.729131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:50.863123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:50.870977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1e2f40b9-bcc1-416c-a4b8-871fd3e5084b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1595 microversion: 2.1 time: 0.154346 Jun 02 09:14:50.871904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 263/537] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:50 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:51.368975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:51.369578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:51.372086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:51.376779 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:51.377226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:51.377990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:51.378419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:51.560719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:51.569047 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e0b5923c-224d-48a8-980b-1ad06ffdd349 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.204082 Jun 02 09:14:51.569807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 275/538] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:51 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:52.585958 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:52.586568 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:52.593084 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:52.593541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:52.594292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:52.594917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:53.061008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:53.063348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=100 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:53.071133 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f7171f8a-82b1-408e-8a17-9d5a09f37a97 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.488938 Jun 02 09:14:53.072040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 264/539] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:52 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:53.348480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-19ba9de2-0cc3-48d0-ba58-0e5aa2a5ff8e req-a3083013-c18d-485d-9d27-56d1a6fabed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:53.356987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-19ba9de2-0cc3-48d0-ba58-0e5aa2a5ff8e req-a3083013-c18d-485d-9d27-56d1a6fabed3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:53.357426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-19ba9de2-0cc3-48d0-ba58-0e5aa2a5ff8e req-a3083013-c18d-485d-9d27-56d1a6fabed3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:53.368399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-19ba9de2-0cc3-48d0-ba58-0e5aa2a5ff8e req-a3083013-c18d-485d-9d27-56d1a6fabed3 service nova] Creating event network-changed:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:14:53.374275 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-19ba9de2-0cc3-48d0-ba58-0e5aa2a5ff8e req-a3083013-c18d-485d-9d27-56d1a6fabed3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029918 Jun 02 09:14:53.377579 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 276/540] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:54.093097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:54.093730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:54.101473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:54.101931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:54.102718 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:54.103157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:54.259148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:54.268182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e9a9bc56-33f2-47bd-8a55-f7a4909065da tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.178637 Jun 02 09:14:54.273447 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 265/541] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:54 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:55.286618 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:55.287266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:55.293505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:55.293961 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:55.294745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:55.295180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:55.433543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:55.441911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-adac5098-bc15-4a2c-959c-44146e9ca52d tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.160480 Jun 02 09:14:55.446184 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 277/542] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:55 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:55.967828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1103477233"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:55.968358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:55.974748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:55.975188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:55.975979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:55.976408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.100604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.network.security_group_api [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Adding security group 3f75560f-3d5f-4e95-a5e0-d8a6d6492f78 to port 13aaa970-60b0-429e-a9cc-576740a99182 Jun 02 09:14:56.459137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:56.459717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:56.466266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:56.466718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.467516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:56.467957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.576771 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-608e4918-4832-45b8-8a83-646f664b677b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.612688 Jun 02 09:14:56.580862 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 266/543] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:14:55 2022] POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:14:56.586480 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:56.587092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:56.597817 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:56.598669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.599749 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:56.600366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.725827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:56.740782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a9c43175-5d9c-438b-bdfa-8f942cb1b1a9 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.285542 Jun 02 09:14:56.744736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 278/544] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:56 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:56.753998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-5b3b715d-60b7-4f3a-a397-1b6b52a52be1 req-60df8cd3-5a8c-4cdd-9724-107e123db259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:14:56.773722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5b3b715d-60b7-4f3a-a397-1b6b52a52be1 req-60df8cd3-5a8c-4cdd-9724-107e123db259 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:56.774437 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5b3b715d-60b7-4f3a-a397-1b6b52a52be1 req-60df8cd3-5a8c-4cdd-9724-107e123db259 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:56.788325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-5b3b715d-60b7-4f3a-a397-1b6b52a52be1 req-60df8cd3-5a8c-4cdd-9724-107e123db259 service nova] Creating event network-changed:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:14:56.793619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:56.793781 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-5b3b715d-60b7-4f3a-a397-1b6b52a52be1 req-60df8cd3-5a8c-4cdd-9724-107e123db259 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045671 Jun 02 09:14:56.794248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 279/545] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:14:56.803577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4e624815-c255-410d-a0a3-623e52a6416d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1760 microversion: 2.1 time: 0.221443 Jun 02 09:14:56.804079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 267/546] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:56 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:14:57.761975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:57.762662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:57.768791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:57.769233 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:57.769989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:57.770418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:57.774421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:14:57.906836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:57.914666 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-98c536e1-6646-4613-9cc6-685f824ea0f8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.157618 Jun 02 09:14:57.915219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 280/547] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:57 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:14:58.932123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:14:58.932739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:14:58.939774 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:58.940608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:58.941070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:14:58.941511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:14:59.065847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:14:59.073876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-03812f7c-296e-4af7-b771-02d5b25149f6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.145599 Jun 02 09:14:59.074446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 268/548] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:14:58 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:00.091773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:00.092387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:00.099930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:00.100389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:00.101228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:00.101673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:00.233107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:00.241329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0793c2e8-10a2-421d-a0bb-d6426ccdb95f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.153484 Jun 02 09:15:00.241922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 281/549] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:00 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:00.988502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff767db8-5768-4ccc-8ca6-b5a818ea42d5", "device": "/dev/sdb"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:00.990147 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:00.996707 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:00.997146 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:00.997897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:00.998322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:01.257945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:01.258495 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:01.265402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:01.265670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:01.266521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:01.266990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:01.395152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:01.403287 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-afd5837e-d9e9-492f-9d48-9477a33a2222 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.149289 Jun 02 09:15:01.403845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 282/550] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:01 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:01.704387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-213bebeb-98c2-430c-b1d0-440498c21313 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "POST /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720045 Jun 02 09:15:01.705112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 269/551] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:15:00 2022] POST /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:02.420777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:02.421390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:02.428682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:02.429127 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:02.429885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:02.430318 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:02.557082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:02.565034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-796fd0a5-4953-4dd4-a76e-c6c5b7a052b8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.148128 Jun 02 09:15:02.565597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 283/552] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:02 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:03.583506 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:03.584207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:03.590312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:03.590756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:03.591572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:03.592008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:03.724196 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:03.732185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7729fc1a-0932-40fc-89b4-ed68576d2c9f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.154005 Jun 02 09:15:03.732689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 270/553] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:03 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:04.749538 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:04.750763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:04.757638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:04.758086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:04.758863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:04.759327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:04.918558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:04.927276 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b4239aa6-fa16-4842-baff-4be824442c03 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.181464 Jun 02 09:15:04.928164 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 284/554] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:04 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:05.943731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:05.944394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:05.950949 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:05.951928 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:05.952694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:05.953126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:06.085114 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:06.093088 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-eaeffe9c-190a-43e8-a253-e59b13b0fc31 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.153207 Jun 02 09:15:06.093648 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 271/555] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:05 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:07.109966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:07.110587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:07.121183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:07.121183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:07.121183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:07.121183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:07.290415 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:07.298328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-be7db9a7-fbb6-4d1a-86f9-5899b3f32e23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.192288 Jun 02 09:15:07.301188 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 285/556] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:07 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:08.318351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:08.318879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:08.321392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=44 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:08.326108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:08.326552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:08.327351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:08.327784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:08.454844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:08.462723 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2f26e709-416a-4071-8390-ef87fd8f4b1f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1736 microversion: 2.1 time: 0.148958 Jun 02 09:15:08.463289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 272/557] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:08 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:09.479716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:09.480331 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:09.486903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.487391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:09.488157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.488589 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:09.617278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:09.625223 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-eba5eddb-85b8-47f8-a810-90db7bcf9f37 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1716 microversion: 2.1 time: 0.149324 Jun 02 09:15:09.625790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 286/558] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:09 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:09.735125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:09.735688 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:09.742481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.743290 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:09.743717 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.744151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:09.866779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] HTTP exception thrown: Cannot 'detach_volume' instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 while it is in vm_state rescued Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Request method failure captured: Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments/ee1d1c24-c7f8-453e-9422-2d963c1fa1d6 HTTP/1.1 Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6w0b80vt-MQlcq-rUG7Y9zL3GFQiyXgT_4p4h71aQnB1saVZjqYoQ-CusqKGm-oyxy8HWoeWhhylre4Z1o4bfZdLw3mb2yE9nw9ROkdq2Ic4WU_Zm1PJWmj3fLCKU_nKSHEwdJjsh0EiEoKE-NwlFqX2b2EZNkfTvkMX42MEH8bkc Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:15:09.868405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1869e20213214111a0dfcda8b7abeecc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: bc0272ac06464fb7b430bc8c664208dd Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:15:09.870059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Cannot 'detach_volume' instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 while it is in vm_state rescued Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'server_id': '19e5281e-07b3-4b55-8fb8-987b3ee1e875', 'id': 'ee1d1c24-c7f8-453e-9422-2d963c1fa1d6'} Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:15:09.870909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 while it is in vm_state rescued Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 while it is in vm_state rescued Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:09.872550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Returning 409 to user: Cannot 'detach_volume' instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 while it is in vm_state rescued {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:15:09.873842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-97af5195-ee81-4c72-8c85-bf8f770fe2bf tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments/ee1d1c24-c7f8-453e-9422-2d963c1fa1d6" status: 409 len: 152 microversion: 2.1 time: 0.138898 Jun 02 09:15:09.873842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 273/559] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:15:09 2022] DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments/ee1d1c24-c7f8-453e-9422-2d963c1fa1d6 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 09:15:09.879458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:09.880021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:09.885997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.886703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:09.891228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:09.891228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:10.073476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-408424d6-2072-478e-a5d6-36d06905bce8 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/action" status: 202 len: 0 microversion: 2.1 time: 0.198274 Jun 02 09:15:10.074018 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 287/560] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:15:09 2022] POST /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:15:10.082730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:10.083370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:10.090154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:10.090598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:10.091515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:10.091945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:10.230161 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:10.238248 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bb23c7b4-9fbc-4e31-8880-8ed87bbd24a2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.159941 Jun 02 09:15:10.238812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 274/561] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:10 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:11.256738 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:11.257440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:11.263940 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:11.264393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:11.265160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:11.265596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:11.394208 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:11.402231 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9cad045e-511a-417f-a882-7701fac0ef95 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.150204 Jun 02 09:15:11.402788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 288/562] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:11 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:12.424383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:12.424983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:12.431660 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:12.432108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:12.432864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:12.433293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:12.563256 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:12.571345 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5be54d8d-9b5b-4731-a658-da0ca311b1d0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.151533 Jun 02 09:15:12.571927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 275/563] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:12 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:13.588588 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:13.589200 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:13.595709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:13.596162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:13.596926 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:13.597362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:13.725970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:13.733986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-863cc6d1-edfb-4776-9f87-2bdf140951c3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.149213 Jun 02 09:15:13.734546 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 289/564] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:13 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:14.751095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:14.751733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:14.758193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:14.758643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:14.759437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:14.759874 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:14.888092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:14.896068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-59719b37-fc92-4bca-9b03-57c81d734709 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.148841 Jun 02 09:15:14.896631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 276/565] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:14 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:15.912710 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:15.913301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:15.919777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:15.920265 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:15.921047 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:15.921489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:16.053194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:16.061147 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-28664dff-c92f-4d32-adc4-1e16dd08c737 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1724 microversion: 2.1 time: 0.152455 Jun 02 09:15:16.061702 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 290/566] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:15 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:17.077892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:17.078513 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:17.085586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:17.086040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:17.088315 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:17.088315 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:17.224089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:17.231925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-937acf27-8c07-4b49-8860-352818048b23 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1730 microversion: 2.1 time: 0.157800 Jun 02 09:15:17.232485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 277/567] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:17 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:17.248512 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:17.249005 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:17.256284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:17.256736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:17.257510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:17.257948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:17.572160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f008e209-8251-4be6-a48d-6f52bedb4fcb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.327452 Jun 02 09:15:17.572757 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 291/568] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:15:17 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-interface => generated 284 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:18.452415 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-c2d7a007-566e-4310-952d-eca53de76ac0 req-9555922e-c86c-40e8-93d4-a692e966d786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:18.461587 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-c2d7a007-566e-4310-952d-eca53de76ac0 req-9555922e-c86c-40e8-93d4-a692e966d786 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:18.462120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-c2d7a007-566e-4310-952d-eca53de76ac0 req-9555922e-c86c-40e8-93d4-a692e966d786 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:18.473282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-c2d7a007-566e-4310-952d-eca53de76ac0 req-9555922e-c86c-40e8-93d4-a692e966d786 service nova] Creating event network-changed:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:15:18.479029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-c2d7a007-566e-4310-952d-eca53de76ac0 req-9555922e-c86c-40e8-93d4-a692e966d786 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030193 Jun 02 09:15:18.480355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 278/569] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:20.495003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-3b54fed2-159a-4c24-bc50-191b6669167a req-65022b60-f2cc-48f3-994d-ebc5cc2856b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:20.504020 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3b54fed2-159a-4c24-bc50-191b6669167a req-65022b60-f2cc-48f3-994d-ebc5cc2856b3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:20.504463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3b54fed2-159a-4c24-bc50-191b6669167a req-65022b60-f2cc-48f3-994d-ebc5cc2856b3 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:20.515931 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-3b54fed2-159a-4c24-bc50-191b6669167a req-65022b60-f2cc-48f3-994d-ebc5cc2856b3 service nova] Creating event network-changed:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:15:20.520931 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-3b54fed2-159a-4c24-bc50-191b6669167a req-65022b60-f2cc-48f3-994d-ebc5cc2856b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030136 Jun 02 09:15:20.521544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 292/570] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:24.097318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:24.097890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:24.104193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.104646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.105443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.105885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.109609 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:24.134649 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c5b8c3fa-aaac-469d-9ed4-6d52d02b13e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments/6208cd74-ba20-481f-8c59-a97ce43685c8" status: 200 len: 194 microversion: 2.20 time: 0.042302 Jun 02 09:15:24.135164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 279/571] 10.222.0.18 () {60 vars in 1453 bytes} [Thu Jun 2 09:15:24 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments/6208cd74-ba20-481f-8c59-a97ce43685c8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:15:24.199632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:24.200219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:24.202130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=36 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:24.207129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.207606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.208371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.208804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.287715 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lazy-loading 'services' on Instance uuid 02b7a340-7dfe-47ad-b8c2-3caa63dda45f {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:15:24.493597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d31aa553-7b46-45a9-9463-7939d2a86fc0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments/6208cd74-ba20-481f-8c59-a97ce43685c8" status: 202 len: 0 microversion: 2.20 time: 0.298590 Jun 02 09:15:24.494179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 293/572] 10.222.0.18 () {60 vars in 1456 bytes} [Thu Jun 2 09:15:24 2022] DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments/6208cd74-ba20-481f-8c59-a97ce43685c8 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:15:24.503534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:24.504446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:24.511548 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.511992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.512757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:24.513189 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:24.541790 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bb510005-1c1d-4242-99da-3f50a67aae2b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043007 Jun 02 09:15:24.542326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 280/573] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 2 09:15:24 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:15:25.554239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:25.555301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:25.561486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:25.562025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:25.562788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:25.563216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:25.596168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4271b546-6b41-49ec-a705-0847ca8be847 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047237 Jun 02 09:15:25.596725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 294/574] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 2 09:15:25 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 09:15:26.607967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:26.608882 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:26.615976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.616423 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:26.617212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.617664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:26.652669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3af0be81-fe3d-4954-9ad9-9b886e231419 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049026 Jun 02 09:15:26.653571 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 281/575] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 2 09:15:26 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:26.710248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:26.714881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:26.717170 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.717616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:26.718399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.718835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:26.743122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:15:26.756869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:26.945675 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2e918197-8b8f-4daa-b61b-5adae15ebe92 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 204 len: 0 microversion: 2.20 time: 0.239541 Jun 02 09:15:26.946263 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 295/576] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 2 09:15:26 2022] DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 09:15:26.954722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:26.956715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:26.961534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.961987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:26.962746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:26.963176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:27.093712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:27.101654 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:27.103145 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:27.105666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-70a1c7a3-68c6-45d7-b50d-480540882199 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.153771 Jun 02 09:15:27.105666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 282/577] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:26 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:28.123880 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:28.124592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:28.131746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:28.132187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:28.132941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:28.133368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:28.260727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:28.268749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:28.270230 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:28.271441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6f3cfb55-80c7-49cd-8d4a-1271b05e5072 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.151889 Jun 02 09:15:28.272027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 296/578] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:28 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:28.452363 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:28.452861 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:28.460008 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:28.460459 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:28.461272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:28.461652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:28.541920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lazy-loading 'services' on Instance uuid bdbdb543-4fcc-4700-870a-38456b5e9b2a {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:15:28.807473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8b5901e3-5335-46b8-8ec9-7341d7853737 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a/os-volume_attachments/ff767db8-5768-4ccc-8ca6-b5a818ea42d5" status: 202 len: 0 microversion: 2.1 time: 0.358628 Jun 02 09:15:28.807984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 283/579] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:15:28 2022] DELETE /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a/os-volume_attachments/ff767db8-5768-4ccc-8ca6-b5a818ea42d5 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:15:29.292655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:29.293370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:29.300289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:29.300739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:29.301506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:29.302428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:29.559100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:29.567203 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:29.568734 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:29.569925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-971396cf-5020-4816-8b6f-6ab186dc8d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1721 microversion: 2.20 time: 0.281125 Jun 02 09:15:29.570481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 297/580] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:29 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:30.224154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-7572d1b4-cf6c-49fb-b967-348872859cd4 req-82093bb0-0968-4186-959f-3a296a9ae29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b7a340-7dfe-47ad-b8c2-3caa63dda45f", "name": "network-vif-deleted", "tag": "752e5bb0-c247-4242-9139-40ee8e80be69"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:30.233514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-7572d1b4-cf6c-49fb-b967-348872859cd4 req-82093bb0-0968-4186-959f-3a296a9ae29c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.233984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-7572d1b4-cf6c-49fb-b967-348872859cd4 req-82093bb0-0968-4186-959f-3a296a9ae29c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:30.247183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-7572d1b4-cf6c-49fb-b967-348872859cd4 req-82093bb0-0968-4186-959f-3a296a9ae29c service nova] Creating event network-vif-deleted:752e5bb0-c247-4242-9139-40ee8e80be69 for instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f on hv-cinder-82549 Jun 02 09:15:30.252391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-7572d1b4-cf6c-49fb-b967-348872859cd4 req-82093bb0-0968-4186-959f-3a296a9ae29c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 Jun 02 09:15:30.256989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 284/581] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:30.589396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:30.590033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:30.596664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.597119 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:30.598103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.598604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:30.630823 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.631290 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:30.631748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lazy-loading 'fault' on Instance uuid 02b7a340-7dfe-47ad-b8c2-3caa63dda45f {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:15:30.685106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:30.693540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:30.695086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:30.696290 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-241aaa40-f736-401b-9300-1a8fe189b459 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 200 len: 1370 microversion: 2.20 time: 0.110809 Jun 02 09:15:30.696847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 298/582] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:30 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:30.984091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:30.984684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:30.991799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.992139 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:30.992926 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:30.993360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:31.026446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:15:31.339454 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ce0d4115-c9dc-459d-ad9c-948bebad0076 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 204 len: 0 microversion: 2.1 time: 0.359124 Jun 02 09:15:31.340141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 285/583] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:15:30 2022] DELETE /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:15:31.349139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:31.350195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:31.358638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:31.359355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:31.360421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:31.362065 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:31.511259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:31.518797 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f8dbd011-42eb-4eb0-ba76-c76352453a1f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1514 microversion: 2.1 time: 0.174167 Jun 02 09:15:31.519392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 299/584] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:31 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:31.715156 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:31.715994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:31.722113 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:31.722656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:31.724136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:31.724575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:31.738281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f HTTP/1.1 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:15:31.740762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:15:31.742483 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '02b7a340-7dfe-47ad-b8c2-3caa63dda45f'} Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:15:31.743319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:15:31.744581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:15:31.745671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:15:31.745671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-90aaa640-8a7f-4060-a49a-de94df175dda tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 404 len: 111 microversion: 2.20 time: 0.031209 Jun 02 09:15:31.745671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 286/585] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:31 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:15:31.750960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f460b23e-271c-4bb6-bcab-148a093227e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '.version_select at 0x7f96702001f0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:31.826383 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f460b23e-271c-4bb6-bcab-148a093227e0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259203824" status: 204 len: 0 microversion: 2.20 time: 0.079146 Jun 02 09:15:31.826985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 300/586] 10.222.0.18 () {60 vars in 1258 bytes} [Thu Jun 2 09:15:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259203824 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 09:15:32.539101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:32.541802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:32.550004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:32.550532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:32.551443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:32.551981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:32.643261 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0de9fab7-315f-4c14-9855-3c23d9e05ffc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: .version_select at 0x7f96701ca040>, body: {"keypair": {"name": "tempest-keypair-1213653854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4vr9NP8nh87DWs9syQj3uwy943KnGcIKf0ukBsCLj0P4q9wGkd+ES1j5QZpJZKv8ajrQFdvs5Cd70opXWpgtpxAgL/YDfHHIZlekWhJ+Gkv6GfzTbZ3pze5PUBCRqO8w=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:32.663081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-0de9fab7-315f-4c14-9855-3c23d9e05ffc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for project 24a81b035f834106b49c35c847f246d6. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:15:32.667399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-0de9fab7-315f-4c14-9855-3c23d9e05ffc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for user 58b706e007fa46c7b8a69508455fcdba and project 24a81b035f834106b49c35c847f246d6. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:15:32.710823 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:32.719200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-805487bf-a892-451c-8126-82f11d4adbf9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1514 microversion: 2.1 time: 0.184415 Jun 02 09:15:32.719909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 287/587] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:32 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:32.752437 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0de9fab7-315f-4c14-9855-3c23d9e05ffc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112423 Jun 02 09:15:32.752437 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 301/588] 10.222.0.18 () {62 vars in 1199 bytes} [Thu Jun 2 09:15:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 02 09:15:33.736261 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:33.736981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:33.748876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:33.748876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:33.748876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:33.748876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:33.971421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:33.978996 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9d555dd1-fcab-489f-bc41-e546e010e597 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1514 microversion: 2.1 time: 0.246811 Jun 02 09:15:33.979614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 288/589] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:33 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:34.487048 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-b50ede34-e354-48f1-bad6-c7c1a61ae8c2 req-a72b9782-b216-4180-8cbb-24ce122e7da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdbdb543-4fcc-4700-870a-38456b5e9b2a", "name": "network-vif-deleted", "tag": "bbabefb0-201d-40ce-afcc-af32fc80d6af"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:34.496498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-b50ede34-e354-48f1-bad6-c7c1a61ae8c2 req-a72b9782-b216-4180-8cbb-24ce122e7da9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:34.499470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-b50ede34-e354-48f1-bad6-c7c1a61ae8c2 req-a72b9782-b216-4180-8cbb-24ce122e7da9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:34.509084 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-b50ede34-e354-48f1-bad6-c7c1a61ae8c2 req-a72b9782-b216-4180-8cbb-24ce122e7da9 service nova] Creating event network-vif-deleted:bbabefb0-201d-40ce-afcc-af32fc80d6af for instance bdbdb543-4fcc-4700-870a-38456b5e9b2a on hv-cinder-82549 Jun 02 09:15:34.514313 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-b50ede34-e354-48f1-bad6-c7c1a61ae8c2 req-a72b9782-b216-4180-8cbb-24ce122e7da9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Jun 02 09:15:34.514914 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 302/590] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:34.996091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:34.996701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:35.003359 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:35.003815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:35.004591 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:35.005028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:35.037027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:35.037482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:35.037941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lazy-loading 'fault' on Instance uuid bdbdb543-4fcc-4700-870a-38456b5e9b2a {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:15:35.081815 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:35.089755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0ab07c1c-47e2-498e-850b-39ffa17c64db tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 200 len: 1308 microversion: 2.1 time: 0.097477 Jun 02 09:15:35.090315 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 289/591] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:34 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:35.200094 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-718486405", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84967763-57f4-4c53-b6ef-7ebe9732f7b0"}], "security_groups": [{"name": "tempest-securitygroup--1621980016"}], "key_name": "tempest-keypair-1213653854", "user_data": "}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:35.302042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] validate_networks() for [('84967763-57f4-4c53-b6ef-7ebe9732f7b0', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:15:35.668721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:15:35.669270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:15:35.669597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:15:35.670002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:15:35.670409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:15:35.680221 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:35.680923 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:35.681574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:35.681991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:35.698510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for project 24a81b035f834106b49c35c847f246d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:15:35.702395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Getting quotas for user 58b706e007fa46c7b8a69508455fcdba and project 24a81b035f834106b49c35c847f246d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:15:35.714406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:15:35.716764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:15:35.860517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7cb0fe88-7578-4369-9320-3ab6829e73ce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.665234 Jun 02 09:15:35.861156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 303/592] 10.222.0.18 () {62 vars in 1187 bytes} [Thu Jun 2 09:15:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 09:15:35.871403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:35.872017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:35.931704 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:35.938994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:35.940526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:35.941623 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7a90adda-013d-4fe7-af44-ce65fb4d2964 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1281 microversion: 2.20 time: 0.074030 Jun 02 09:15:35.942732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 290/593] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:35 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:36.109835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:36.110442 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: bdbdb543-4fcc-4700-870a-38456b5e9b2a] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:36.117322 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:36.117765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:36.118528 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:36.118957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:36.133088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] HTTP exception thrown: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Request method failure captured: Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a HTTP/1.1 Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH9j9XcNSRlzav36eNkQ913H5IMYLtGWOjBHTDNwa9HUlg5GpYgjxTzCsklp1Q0MBf9v9HCA5c0MuRg7X7BvrYazIdfVmWtFQ85HloQMzezlqrsJ6xzaiWotrPdVOgLBPDPemItaGVzEsm_Xn3gsJWoVQxf_CSACTePTRMFK7i29eAE Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: c5393c21cbc043318c9338c11264d29d Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:15:36.134860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5393c21cbc043318c9338c11264d29d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: c5393c21cbc043318c9338c11264d29d Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesSnapshotTestJSON-797723962-project Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: dd2ce82718c341e8b1c321a2f128375d Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesSnapshotTestJSON-797723962-project Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. Jun 02 09:15:36.136691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'bdbdb543-4fcc-4700-870a-38456b5e9b2a'} Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:15:36.137682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. Jun 02 09:15:36.139267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:36.140518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Returning 404 to user: Instance bdbdb543-4fcc-4700-870a-38456b5e9b2a could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:15:36.140518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4b15f911-b2e6-4afc-819d-6c5066bcc320 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a" status: 404 len: 111 microversion: 2.1 time: 0.030737 Jun 02 09:15:36.140518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 304/594] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:36 2022] GET /compute/v2.1/servers/bdbdb543-4fcc-4700-870a-38456b5e9b2a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:15:36.960527 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:36.961137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:36.967776 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:36.968227 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:36.968999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:36.969439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.030404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:37.038614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:37.040193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:37.042104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9304f2e5-2d99-4709-b76d-ea7e93617c6b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1285 microversion: 2.20 time: 0.086154 Jun 02 09:15:37.042855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 291/595] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:36 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:37.108494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:37.109471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:37.116303 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.116762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.117563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.117988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.150223 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-aaaeebbb-f2bf-4c8e-8044-903860e7558e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046206 Jun 02 09:15:37.150774 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 305/596] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:15:37 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:15:37.206988 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:37.208183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:37.214107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.214555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.215360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.215794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.242150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:15:37.265241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:37.266192 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:37.272756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.273203 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.273976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.274411 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.525696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-122cbb6e-12c9-4466-b269-80af9babb3b0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.264355 Jun 02 09:15:37.526325 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 306/597] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:15:37 2022] POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 09:15:37.533669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-72102ca7-1749-4e37-aa91-cfc2b4438525 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 204 len: 0 microversion: 2.1 time: 0.330295 Jun 02 09:15:37.537518 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 292/598] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:15:37 2022] DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:15:37.537639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:37.537639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:37.541818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.542356 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.542544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:37.543209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.543336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:37.543699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.549093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.549538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.550299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:37.550732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:37.749566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:37.751999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:37.756310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:37.757891 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-26b2774a-4d69-4e6a-b0fe-1cd58b3e28f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1676 microversion: 2.1 time: 0.219228 Jun 02 09:15:37.758465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 293/599] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:37 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:37.764534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-272addce-5401-41be-8cb6-1240493dc050 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.233913 Jun 02 09:15:37.765175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 307/600] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:37 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:38.059642 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:38.060242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:38.067463 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.067906 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.068728 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.069156 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.133075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:38.141052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:38.142537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:38.143657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9a3a3e92-5819-46cc-8825-1148c575491a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1277 microversion: 2.20 time: 0.087864 Jun 02 09:15:38.144205 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 294/601] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:38 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:38.775247 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:38.775889 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:38.782466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.782946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.783745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.784183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.786482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:38.787091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:38.789004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:38.793703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.794224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.794995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:38.795461 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:38.979808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:38.987298 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f34f3768-021c-4590-911b-b2c4b47de326 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1676 microversion: 2.1 time: 0.215857 Jun 02 09:15:38.987862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 308/602] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:38 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:38.994582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:39.002788 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d888e2e9-cf1c-4de4-bc03-d1c20df94c19 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.220618 Jun 02 09:15:39.003334 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 295/603] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:38 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:39.166449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:39.166986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:39.173057 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:39.173507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:39.174271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:39.174705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:39.236919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:39.244625 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:39.246124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:39.247212 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6323bb82-c75c-43df-8c07-f25fcc497a0f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1277 microversion: 2.20 time: 0.084763 Jun 02 09:15:39.247776 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 309/604] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:39 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:40.005006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:40.005616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:40.012355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.012801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.013569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.014002 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.019958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:40.020560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:40.026960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.027440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.028204 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.028641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.220987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:40.228905 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c224923d-fe02-4087-9331-b1b5c8b2363d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1676 microversion: 2.1 time: 0.227940 Jun 02 09:15:40.229468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 296/605] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:39 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:40.234333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:40.243053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6c7e1165-f7d1-46be-bb24-2d4b9d218a2d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.227111 Jun 02 09:15:40.243619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 310/606] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:40 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:40.265712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:40.266312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:40.273450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.274250 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.275545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:40.275986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:40.337302 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:40.345130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:40.346610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:40.347786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-06924299-15a6-4043-9062-2f7eed8ab462 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1333 microversion: 2.20 time: 0.085876 Jun 02 09:15:40.348923 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 297/607] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:40 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:41.246238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:41.246797 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:41.253678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.256673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.256673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.256673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.260058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:41.260662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:41.267487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.267932 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.268893 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.269424 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.460912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:41.468712 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3659be90-2fa0-4e14-aeaa-c3e42c4513a1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1676 microversion: 2.1 time: 0.226523 Jun 02 09:15:41.469605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 311/608] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:41 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:41.474245 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:41.474982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:41.476521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:41.481252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.481694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.482464 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:41.482897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:41.485260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2283725c-79ca-4570-aae2-4746ae8cdbbe tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.228991 Jun 02 09:15:41.485694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 298/609] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:41 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:41.544235 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:41.551962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:41.553456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:41.554549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-91f5fa99-7b31-4db6-b1f2-321094b5766d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1333 microversion: 2.20 time: 0.083987 Jun 02 09:15:41.555116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 312/610] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:41 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:42.489507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:42.489507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:42.496846 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.502118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:42.502722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:42.506688 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.510471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.511172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.512263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.512701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.517851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.518541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.828235 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:42.837289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-532caa69-390a-41fe-9fd5-9aaa48f5b067 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1676 microversion: 2.1 time: 0.354269 Jun 02 09:15:42.841960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:42.844363 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:42.849097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 299/611] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:42 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1676 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:42.854187 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:42.854921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:42.858243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f188f745-a011-4e7d-94e2-43058a672aa3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.359639 Jun 02 09:15:42.867833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 313/612] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:42 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:42.868017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.868017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.868017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:42.868017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:42.927445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:42.936219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:42.937793 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:42.939201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b7c5bec5-9d6d-4a65-8366-16e8d2dc066c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1351 microversion: 2.20 time: 0.088872 Jun 02 09:15:42.939854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 300/613] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:42 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:43.222996 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-8176e992-14b7-4e77-860e-926d65852a10 req-8b4fc94c-9811-4a18-ab48-e120c9a09619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b19073d8-fcec-4ea0-945a-c532266bf751", "name": "network-vif-deleted", "tag": "cba0b34d-2285-4a05-b72a-0bc3109cf26f"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:43.231446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-8176e992-14b7-4e77-860e-926d65852a10 req-8b4fc94c-9811-4a18-ab48-e120c9a09619 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.231835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-8176e992-14b7-4e77-860e-926d65852a10 req-8b4fc94c-9811-4a18-ab48-e120c9a09619 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.242801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-8176e992-14b7-4e77-860e-926d65852a10 req-8b4fc94c-9811-4a18-ab48-e120c9a09619 service nova] Creating event network-vif-deleted:cba0b34d-2285-4a05-b72a-0bc3109cf26f for instance b19073d8-fcec-4ea0-945a-c532266bf751 on hv-cinder-82549 Jun 02 09:15:43.247739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-8176e992-14b7-4e77-860e-926d65852a10 req-8b4fc94c-9811-4a18-ab48-e120c9a09619 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028717 Jun 02 09:15:43.248328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 314/614] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:43.856185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:43.856795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:43.864108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.864507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.865284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.865727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.876713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:43.877435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:43.884655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.885096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.886120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.886705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.946974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:43.957736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9e6c9fb2-e8ad-425b-8860-517563e9a7eb tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1608 microversion: 2.1 time: 0.105284 Jun 02 09:15:43.967453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 301/615] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:43 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:43.967453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:43.967453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:43.971444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.971999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:43.973429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:43.973967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:44.048512 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:44.058027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:44.059745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:44.060944 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4ccc7035-0425-4d0d-95b3-f01d83eb2c79 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1339 microversion: 2.20 time: 0.100915 Jun 02 09:15:44.065225 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 302/616] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:43 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:44.089475 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:44.097581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-75d7611d-2600-45bf-ac6f-ee65dcc89a38 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.225516 Jun 02 09:15:44.098720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 315/617] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:43 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:44.976606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:44.977215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:44.983754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:44.984195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:44.984956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:44.985388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:45.045849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:45.053291 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-90f1e59d-6c94-46d2-99d0-1b9f942d69ba tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1608 microversion: 2.1 time: 0.081170 Jun 02 09:15:45.053854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 303/618] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:44 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1608 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:45.079195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:45.079845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:45.086876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:45.091025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:45.091025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:45.091025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:45.115227 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:45.115853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:45.121950 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:45.122389 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:45.123149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:45.123722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:45.162931 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:45.170975 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:45.172517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:45.173620 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7af37e60-769c-46f3-949f-79dba3edb900 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1339 microversion: 2.20 time: 0.098364 Jun 02 09:15:45.174176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 316/619] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:45 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:45.266818 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:45.275364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9bb00d86-ff83-498a-b02a-6fc47563e883 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1752 microversion: 2.1 time: 0.163861 Jun 02 09:15:45.275918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 304/620] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:45 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:46.070603 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:46.071143 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:46.073206 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:46.073949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=10 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:46.078813 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.079299 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.080124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.080566 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.115431 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.115879 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.116506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lazy-loading 'fault' on Instance uuid b19073d8-fcec-4ea0-945a-c532266bf751 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:15:46.181236 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:46.190919 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-362b1f07-6d38-4108-bc6a-21c3f66403d7 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 200 len: 1328 microversion: 2.1 time: 0.124333 Jun 02 09:15:46.192955 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:46.194221 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:46.200934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 317/621] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:46 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:46.201828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:46.203606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.204059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.204849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.205358 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.292416 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:46.294468 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:46.302615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.303066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.303941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:46.312655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:46.413767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:46.422013 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:46.423529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:46.425445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dd73d346-9ae5-4e00-956e-0c1126ee1139 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.237068 Jun 02 09:15:46.425445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 305/622] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:46 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:46.574425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:46.584840 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0af997d7-800e-4b64-b623-0871b0e31d29 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.296401 Jun 02 09:15:46.591581 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 318/623] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:46 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:46.625872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1275042664", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "networks": [{"uuid": "ddf73512-4ae1-4e43-b5fb-0ba1c1fdcfe2"}]}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:46.677645 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] validate_networks() for [('ddf73512-4ae1-4e43-b5fb-0ba1c1fdcfe2', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:15:47.207906 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:47.208951 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:15:47.209387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:47.210067 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:15:47.210803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:15:47.211485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:15:47.212116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:15:47.218558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.219842 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.222160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.223013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.224509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.226273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.226273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.226273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.239795 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 HTTP/1.1 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:15:47.241449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:15:47.242731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'b19073d8-fcec-4ea0-945a-c532266bf751'} Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:15:47.243555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:15:47.244699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:15:47.245792 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:15:47.245792 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7b77e3bf-92e7-4822-8e5a-d2b38b7691b4 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 404 len: 111 microversion: 2.1 time: 0.038985 Jun 02 09:15:47.245927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Getting quotas for project c5393c21cbc043318c9338c11264d29d. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:15:47.246835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 319/624] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:47 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:15:47.250586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Getting quotas for user dd2ce82718c341e8b1c321a2f128375d and project c5393c21cbc043318c9338c11264d29d. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:15:47.252610 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ab5ea821-14b3-427e-bce2-aba72a5f8373 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '.version_select at 0x7f96702c43a0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:47.263513 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:15:47.267107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:15:47.322137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ab5ea821-14b3-427e-bce2-aba72a5f8373 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900334956" status: 202 len: 0 microversion: 2.1 time: 0.073144 Jun 02 09:15:47.322667 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 320/625] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 2 09:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900334956 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:15:47.387585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9ea92f17-d450-4972-b518-b83df71768c9 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765748 Jun 02 09:15:47.388269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 306/626] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:15:47.398544 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a5247780-f844-483c-ac46-159ef82b8007 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:47.399627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a5247780-f844-483c-ac46-159ef82b8007 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:47.442386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:47.443033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:47.453027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.453477 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.454263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.454701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.592852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a5247780-f844-483c-ac46-159ef82b8007 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:47.602695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a5247780-f844-483c-ac46-159ef82b8007 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1219 microversion: 2.1 time: 0.207850 Jun 02 09:15:47.603478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 321/627] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:47 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:47.608654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-5cd1911c-ffa2-408a-9d94-fa6ba558c66d req-88c0ced6-fdd9-41d0-aafd-fa8fc9fdda3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:47.614030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:47.621124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5cd1911c-ffa2-408a-9d94-fa6ba558c66d req-88c0ced6-fdd9-41d0-aafd-fa8fc9fdda3d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.621507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5cd1911c-ffa2-408a-9d94-fa6ba558c66d req-88c0ced6-fdd9-41d0-aafd-fa8fc9fdda3d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.637489 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-5cd1911c-ffa2-408a-9d94-fa6ba558c66d req-88c0ced6-fdd9-41d0-aafd-fa8fc9fdda3d service nova] Creating event network-changed:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:15:47.642545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-5cd1911c-ffa2-408a-9d94-fa6ba558c66d req-88c0ced6-fdd9-41d0-aafd-fa8fc9fdda3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037649 Jun 02 09:15:47.643940 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 322/628] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:47.650042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:47.651169 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:47.658846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.659319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.660807 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:47.661412 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:47.843614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:47.853096 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:47.854930 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:47.856080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f3f20c89-eedb-4b35-b4df-d4fadd189daf tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.418175 Jun 02 09:15:47.856760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 307/629] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:47 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:47.974882 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:47.986221 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0ad14098-f4ef-4e9f-8ae0-f0a919307d9c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.340753 Jun 02 09:15:47.986956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 323/630] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:47 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:48.474535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-79b2ea87-351a-438b-a09e-f2731e09d322 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: .version_select at 0x7f9670348670>, body: {"keypair": {"name": "tempest-keypair-25083928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf4R4Gc68+fanKOJ1pRskuFLLWLl6Kx/yv7aWuNopy1Qb1m6FiI80nNgjCd2X0zz3R4WbfSoPhx+T4qprVSXhV21bjSb1RQByH35WgvW8glRfT9lrEO8u2ExJpTGmWUvA=="}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:48.489258 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-79b2ea87-351a-438b-a09e-f2731e09d322 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for project 597dc461d8a042e19ad99324a626aac1. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:15:48.493295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-79b2ea87-351a-438b-a09e-f2731e09d322 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for user 0d89a238fc8047cdaaac1047a675cfbb and project 597dc461d8a042e19ad99324a626aac1. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:15:48.580331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-79b2ea87-351a-438b-a09e-f2731e09d322 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.109851 Jun 02 09:15:48.580937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 308/631] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:15:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:48.620078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:48.620689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:48.627216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:48.627700 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:48.628548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:48.629627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:48.697393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:48.704904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ebe3a6b1-cbcf-4cb8-8423-4991850ef434 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1223 microversion: 2.1 time: 0.088863 Jun 02 09:15:48.705699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 324/632] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:48 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:48.874107 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:48.877027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:48.881585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:48.882028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:48.882795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:48.883222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:49.002894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:49.003528 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:49.009513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:49.009963 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:49.010980 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:49.011440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:49.064119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:49.072769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:49.074292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:49.075497 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-36912c58-b10c-412e-ab8f-9a1473a18317 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.205390 Jun 02 09:15:49.076076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 309/633] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:48 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:49.188988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:49.197091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e361bfe7-f165-4648-a6d9-3986a7b5b1d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.198290 Jun 02 09:15:49.197646 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 325/634] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:48 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:49.721688 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:49.722202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:49.729903 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:49.730342 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:49.731460 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:49.731895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:49.836530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:49.851376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a091a9fe-d66d-4a8f-b63b-eb8a3283bf3d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1215 microversion: 2.1 time: 0.126498 Jun 02 09:15:49.851376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 310/635] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:49 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:50.093613 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:50.094258 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:50.100914 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.101562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.102342 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.102777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.215186 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:50.215810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:50.222061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.222508 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.223299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.223731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.284662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:50.292884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:50.294311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:50.295433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5378190e-38d6-4c03-bb40-e2f72dc4825d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.205764 Jun 02 09:15:50.295985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 326/636] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:50 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:50.552746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:50.562331 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ba1d2b1f-4957-4a1c-a564-7824471e684d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.351810 Jun 02 09:15:50.576669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 311/637] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:50 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:50.861083 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:50.861694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:50.868034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.868722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.874342 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:50.874342 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:50.957445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:50.965013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c278ef3d-dc47-4ba3-b4f6-431449c52852 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1289 microversion: 2.1 time: 0.107756 Jun 02 09:15:50.965669 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 327/638] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:50 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:51.316820 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:51.317426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:51.323158 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416930428", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46dd9852-216f-49d7-b4d1-ee3ded9a21b2"}], "security_groups": [{"name": "tempest-securitygroup--1297391913"}], "key_name": "tempest-keypair-25083928", "user_data": "}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:51.324786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.325231 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.325997 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.326428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.329167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=100 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:51.465595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] validate_networks() for [('46dd9852-216f-49d7-b4d1-ee3ded9a21b2', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:15:51.544891 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:51.553166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:51.554758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:51.555892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7082d960-8f4b-4f7f-8354-e0ab2a682d94 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.245306 Jun 02 09:15:51.556637 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 312/639] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:51 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:51.579584 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:51.580293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:51.587201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.587937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.588885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.589825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.853761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:51.862054 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-55b05224-8d24-4e2c-a2ef-58802644d034 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.286190 Jun 02 09:15:51.862623 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 313/640] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:51 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:51.867651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-5cea3195-71ab-4f63-a3d0-9b98b4796fa2 req-3a3deb10-26e3-4dfa-9fde-81548c1a7f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "name": "network-vif-plugged", "status": "completed", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:51.876844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-5cea3195-71ab-4f63-a3d0-9b98b4796fa2 req-3a3deb10-26e3-4dfa-9fde-81548c1a7f4e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.877280 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-5cea3195-71ab-4f63-a3d0-9b98b4796fa2 req-3a3deb10-26e3-4dfa-9fde-81548c1a7f4e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.890294 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-5cea3195-71ab-4f63-a3d0-9b98b4796fa2 req-3a3deb10-26e3-4dfa-9fde-81548c1a7f4e service nova] Creating event network-vif-plugged:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:15:51.895745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-5cea3195-71ab-4f63-a3d0-9b98b4796fa2 req-3a3deb10-26e3-4dfa-9fde-81548c1a7f4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 Jun 02 09:15:51.899631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 314/641] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:51.958815 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:15:51.959363 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:15:51.959932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:15:51.960625 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:15:51.961050 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:15:51.970435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.970892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.971745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:51.972194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:51.989095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:51.990079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:51.991102 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for project 597dc461d8a042e19ad99324a626aac1. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:15:51.996440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Getting quotas for user 0d89a238fc8047cdaaac1047a675cfbb and project 597dc461d8a042e19ad99324a626aac1. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:15:51.999683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.002247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.002247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.002247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.011675 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:15:52.014086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:15:52.140987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:52.150201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9aded66c-be11-4a26-884a-30b59e00812f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.168017 Jun 02 09:15:52.151279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 315/642] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:51 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:52.153833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bc5f9a87-34e7-47e2-8772-7434149274c2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.834922 Jun 02 09:15:52.154796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 328/643] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:15:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 09:15:52.170421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e1c8aeed-4e52-4ecf-bddf-e5f4101f1fb2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:52.170944 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e1c8aeed-4e52-4ecf-bddf-e5f4101f1fb2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:52.236036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e1c8aeed-4e52-4ecf-bddf-e5f4101f1fb2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:52.246751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e1c8aeed-4e52-4ecf-bddf-e5f4101f1fb2 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1236 microversion: 2.1 time: 0.080019 Jun 02 09:15:52.253897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 316/644] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:52 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:52.505103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-2cf9d584-f603-4679-a1dd-744b7914eafa req-17e7a1b8-ba81-4775-9f2b-4b2c8316d5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e85fc8-97fb-40cc-9dca-d80d7fadf34e", "tag": "13effa59-07f8-46b9-9a61-b7d214f75eae"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:52.516517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2cf9d584-f603-4679-a1dd-744b7914eafa req-17e7a1b8-ba81-4775-9f2b-4b2c8316d5eb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.517066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2cf9d584-f603-4679-a1dd-744b7914eafa req-17e7a1b8-ba81-4775-9f2b-4b2c8316d5eb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.533320 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-2cf9d584-f603-4679-a1dd-744b7914eafa req-17e7a1b8-ba81-4775-9f2b-4b2c8316d5eb service nova] Creating event network-changed:13effa59-07f8-46b9-9a61-b7d214f75eae for instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e on hv-cinder-82549 Jun 02 09:15:52.539080 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-2cf9d584-f603-4679-a1dd-744b7914eafa req-17e7a1b8-ba81-4775-9f2b-4b2c8316d5eb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038417 Jun 02 09:15:52.539718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 329/645] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:52.573869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:52.574471 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:52.581618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.582580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.583368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.583804 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.729351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:52.740371 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:52.742999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:52.744843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1e841333-fa66-42a4-ad9e-02e99f4d097c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1407 microversion: 2.20 time: 0.174692 Jun 02 09:15:52.745401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 317/646] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:52 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:52.881023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:52.881721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:52.888139 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.893458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:52.893458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:52.893458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.030788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.038692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3324279e-9f7d-4de2-8cce-ecd10c6cc7f1 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.162553 Jun 02 09:15:53.039257 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 330/647] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:52 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:53.168482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:53.169126 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:53.175166 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.176134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.177028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.177427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.263948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:53.264831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:53.271478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.271934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.272714 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.273156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.322002 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.329819 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-760da230-6a5a-4016-ba37-cb6448e681cf tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.165154 Jun 02 09:15:53.335283 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 318/648] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:53 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:53.342121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.349540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2b81d697-8481-4c5e-8317-b73c8cd2ff32 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1240 microversion: 2.1 time: 0.089754 Jun 02 09:15:53.350321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 331/649] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:53 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:53.764056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:53.764661 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:53.771387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.771871 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.772653 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.773093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.900134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.907848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.909350 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:53.911162 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cb7728ee-b6a7-41a3-bedd-648c06422cbb tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1599 microversion: 2.20 time: 0.151207 Jun 02 09:15:53.911691 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 319/650] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:15:53 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:15:53.928231 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:53.928732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:53.934836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.935309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:53.936073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:53.936508 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.017036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-850bbef1-7f92-436b-9839-90f5f22e02b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092574 Jun 02 09:15:54.017634 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 332/651] 10.222.0.18 () {60 vars in 1315 bytes} [Thu Jun 2 09:15:53 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:15:54.054735 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:54.055472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:54.061593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.062108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.062939 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.063478 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.323102 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:54.331014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7074f70f-2d31-40c4-8131-5cbed8d29ca0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.280082 Jun 02 09:15:54.332307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 320/652] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:54 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:54.345901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:54.346548 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:54.352594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.353052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.353830 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.354271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.365699 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:54.366430 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:54.372919 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.372919 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.373855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:54.374354 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:54.508387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:54.516195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-10f1220e-7205-4d72-9f51-73b75221de6e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1288 microversion: 2.1 time: 0.154243 Jun 02 09:15:54.516779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 321/653] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:54 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1288 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:54.619995 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:54.629385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-780c5035-31a9-4677-9c46-df076bbbdd2d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.286631 Jun 02 09:15:54.629955 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 333/654] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:54 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:55.349499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:55.350061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:55.356509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.356948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.357711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.358143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.536681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:55.537329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:55.543619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.544097 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.544878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.545307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.617952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:55.626257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9d66f060-9852-4776-b12e-ab50a2f00c49 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.281272 Jun 02 09:15:55.626898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 322/655] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:55 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:55.638833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:55.646314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-908cfc56-22b8-444b-812d-5c85ee6ac9e9 req-c17df61e-a120-467d-9fc0-2d16ad97934e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:55.648558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2bb07d46-caa5-453b-85fb-ab03cf15555c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1306 microversion: 2.1 time: 0.118461 Jun 02 09:15:55.649210 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 334/656] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:55 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1306 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:55.654795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-908cfc56-22b8-444b-812d-5c85ee6ac9e9 req-c17df61e-a120-467d-9fc0-2d16ad97934e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.656562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:55.656675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-908cfc56-22b8-444b-812d-5c85ee6ac9e9 req-c17df61e-a120-467d-9fc0-2d16ad97934e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.656783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:55.668652 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.668831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.669210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-908cfc56-22b8-444b-812d-5c85ee6ac9e9 req-c17df61e-a120-467d-9fc0-2d16ad97934e service nova] Creating event network-changed:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:15:55.669832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:55.670378 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:55.674284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-908cfc56-22b8-444b-812d-5c85ee6ac9e9 req-c17df61e-a120-467d-9fc0-2d16ad97934e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Jun 02 09:15:55.675040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 323/657] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:55.799843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:55.802374 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:55.808179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f2968040-26dc-425c-8e16-10f656e60bd0 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.157653 Jun 02 09:15:55.808746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 335/658] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:55 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:56.643825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:56.645514 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:56.655448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:56.656178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:56.657359 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:56.657963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:56.672999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:56.673631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:56.689756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:56.690208 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:56.691059 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:56.696370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:57.006534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:57.014296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8e815fbf-9b41-4246-9da0-0eda930fdf4d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.349847 Jun 02 09:15:57.014852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 336/659] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:56 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:57.019824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:57.020861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:57.026925 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:57.027404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:57.032866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:57.032866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:57.042941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:57.051171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8a94f21d-2921-49b0-b5cd-d77b636a658a tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.411256 Jun 02 09:15:57.061058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 324/660] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:56 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:57.261153 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:57.268650 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-606c9f6f-2f36-4ac2-8f9b-95dd149b4aa1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.252803 Jun 02 09:15:57.269904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 337/661] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:57 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:57.828553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-cb403e90-9f2d-4bdb-8640-34794fe6c83a req-3505933e-b6ee-496c-96ad-9a4640d5ca89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d1406b-df8a-4eda-8814-e751b31b5d08", "tag": "a0c164ca-6ded-4707-b14f-e26cae0a08e0"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:57.836223 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:15:57.840888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-cb403e90-9f2d-4bdb-8640-34794fe6c83a req-3505933e-b6ee-496c-96ad-9a4640d5ca89 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:57.841346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-cb403e90-9f2d-4bdb-8640-34794fe6c83a req-3505933e-b6ee-496c-96ad-9a4640d5ca89 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:57.860919 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-cb403e90-9f2d-4bdb-8640-34794fe6c83a req-3505933e-b6ee-496c-96ad-9a4640d5ca89 service nova] Creating event network-changed:a0c164ca-6ded-4707-b14f-e26cae0a08e0 for instance d9d1406b-df8a-4eda-8814-e751b31b5d08 on hv-cinder-82549 Jun 02 09:15:57.866183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-cb403e90-9f2d-4bdb-8640-34794fe6c83a req-3505933e-b6ee-496c-96ad-9a4640d5ca89 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041003 Jun 02 09:15:57.866793 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 325/662] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:58.032212 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:58.032852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:58.039969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.040412 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.041207 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.041621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.070045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:58.070835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:58.077878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.078519 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.079436 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.080643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.305069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:58.315012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4a0a70ff-bbb5-4a7f-a5ad-4326226440a8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.286719 Jun 02 09:15:58.318406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 338/663] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:58 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:58.321223 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:58.321825 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:58.327794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.328236 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.328994 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:58.329421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:58.360299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:58.369206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a7c36931-dcbf-4bf2-a44a-2618b92357fb tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.304240 Jun 02 09:15:58.370014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 326/664] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:58 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:58.495467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:58.502969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7ddf9f5a-182c-4304-820a-e4472903a123 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.185344 Jun 02 09:15:58.504259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 339/665] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:58 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:59.333417 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:59.333972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:59.340503 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.340955 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.341721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.342188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.387536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:59.388178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:59.395195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.395673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.396442 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.396878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.512615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:59.521479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f6d88e8a-ed78-47a7-b4c4-0b423b3dcf00 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.192385 Jun 02 09:15:59.526906 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 327/666] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:59 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:59.533802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:59.534422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:59.542801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.543267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.544085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.544516 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.580141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:59.589205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cbe5c932-1ba0-4d81-8c89-48cf95f0cdc9 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.205792 Jun 02 09:15:59.589779 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 340/667] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:59 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:15:59.684087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:15:59.692151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-35908ff7-a3e1-49c8-93e6-eeded254f1ac tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.164072 Jun 02 09:15:59.692710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 328/668] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:15:59 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:15:59.699590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-11c61276-346d-4728-b7f5-6094f13b4af4 req-82644661-690d-4fb3-a8b6-65b2d128e7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e85fc8-97fb-40cc-9dca-d80d7fadf34e", "name": "network-vif-plugged", "status": "completed", "tag": "13effa59-07f8-46b9-9a61-b7d214f75eae"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:15:59.708531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-11c61276-346d-4728-b7f5-6094f13b4af4 req-82644661-690d-4fb3-a8b6-65b2d128e7e5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.709042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-11c61276-346d-4728-b7f5-6094f13b4af4 req-82644661-690d-4fb3-a8b6-65b2d128e7e5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.720649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-11c61276-346d-4728-b7f5-6094f13b4af4 req-82644661-690d-4fb3-a8b6-65b2d128e7e5 service nova] Creating event network-vif-plugged:13effa59-07f8-46b9-9a61-b7d214f75eae for instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e on hv-cinder-82549 Jun 02 09:15:59.725673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-11c61276-346d-4728-b7f5-6094f13b4af4 req-82644661-690d-4fb3-a8b6-65b2d128e7e5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029798 Jun 02 09:15:59.726255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 341/669] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:15:59.770790 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:15:59.771306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:15:59.777346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.777785 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.778569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:15:59.778980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:15:59.865754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'services' on Instance uuid 19e5281e-07b3-4b55-8fb8-987b3ee1e875 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:00.058130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bc5b1a4d-9b88-4e96-97f5-8f80cd98a3b2 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments/ee1d1c24-c7f8-453e-9422-2d963c1fa1d6" status: 202 len: 0 microversion: 2.1 time: 0.292512 Jun 02 09:16:00.058730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 329/670] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:15:59 2022] DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments/ee1d1c24-c7f8-453e-9422-2d963c1fa1d6 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:16:00.068395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:00.069437 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:00.075643 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.076086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.076845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.077275 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.107471 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-18d21c68-995b-470b-a3e6-ce44264d93ec tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Jun 02 09:16:00.107933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 342/671] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:00 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:00.539221 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:00.539945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:00.546780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.547261 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.548031 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.548475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.605969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:00.606592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:00.613155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.613608 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.614391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.614833 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.686927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:00.694595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f5716d6c-82ed-4347-a449-f84816f850dd tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.160005 Jun 02 09:16:00.695171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 330/672] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:00 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:00.709582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:00.710193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:00.716334 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.716782 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.717562 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:00.717995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:00.722725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:00.987849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:00.995378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-805d85b9-ec2a-4c18-b50c-bfaf69deca4f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.290163 Jun 02 09:16:00.995953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 331/673] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:00 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:01.006924 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:01.015282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7a0fd1b5-b054-49d2-8ebc-e86b1484a8d4 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.413278 Jun 02 09:16:01.015851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 343/674] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:00 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:01.120495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:01.121501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:01.123404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:01.128634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:01.129096 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:01.129860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:01.130295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:01.159975 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a551aead-91f1-44d9-8190-97df6aa1e2c4 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Jun 02 09:16:01.160532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 332/675] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:01 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:01.710912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:01.711779 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:01.718317 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:01.718861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:01.719719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:01.720167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:01.849605 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:01.857174 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-79075c8d-2ed4-49a0-a49a-8733a7aaea73 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.150184 Jun 02 09:16:01.857732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 344/676] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:01 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:02.012532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.013137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.020323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.020768 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.021559 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.021988 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.032986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.033862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.036338 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:02.037239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=8 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:02.042013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.042457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.043227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.043678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.229042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:02.241044 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ab677608-3051-4359-bc4f-96f3a3935dc6 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1319 microversion: 2.1 time: 0.232457 Jun 02 09:16:02.245066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:02.250590 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 333/677] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:02 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:02.253403 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-079b1749-94b3-4e30-ba2e-398326e2130c tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1757 microversion: 2.1 time: 0.224144 Jun 02 09:16:02.255400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 345/678] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:02 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1757 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:02.259985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.259985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.259985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=12 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:02.264175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.264626 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.265401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.265839 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.298177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-922dfb3f-ab56-4483-bc9f-2d25b5b3bd64 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046162 Jun 02 09:16:02.299052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 334/679] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:02 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:16:02.379462 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.380106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.386307 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.386750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.387589 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.388019 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.413352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:16:02.674749 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cd9b52b4-00f5-4afa-b856-1ee399ba66ba tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 204 len: 0 microversion: 2.1 time: 0.298930 Jun 02 09:16:02.675364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 346/680] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:16:02 2022] DELETE /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:16:02.683495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.684097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.690477 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.691460 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.692216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.692641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.874642 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:02.876402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:02.884419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.884983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.885116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:02.886230 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:02.886772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:02.893712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b8a97529-39d1-4459-981f-ef70cc435f58 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1690 microversion: 2.1 time: 0.214064 Jun 02 09:16:02.894292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 335/681] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:02 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:03.018526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:03.025974 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9ffda8db-4cee-4c01-98d7-c530670d0780 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.155795 Jun 02 09:16:03.026534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 347/682] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:02 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:03.257858 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:03.258470 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:03.265364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.265807 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.266565 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.266996 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.275384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:03.276000 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:03.282007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.282456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.283246 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.283693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.460101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:03.467451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-88ae42ed-ec5e-4d98-a55e-36ec403f89cb tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1508 microversion: 2.1 time: 0.213492 Jun 02 09:16:03.468001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 336/683] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:03 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:03.480044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:03.484789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07a81e46-f07a-4b12-8ed9-6cfe5e99835f", "device": "/dev/sdb"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:03.485914 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:03.488620 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-59a7b05a-acf5-4b93-91f2-005856ee56e2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1760 microversion: 2.1 time: 0.217059 Jun 02 09:16:03.489430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 348/684] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:03 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1760 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:03.492682 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.493129 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.493888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.494319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.738621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-84505b0f-7448-4a73-8c26-b4aedf614304 req-bd84f8e3-139d-405e-b526-78214d61dedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d1406b-df8a-4eda-8814-e751b31b5d08", "name": "network-vif-plugged", "status": "completed", "tag": "a0c164ca-6ded-4707-b14f-e26cae0a08e0"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:03.746813 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-84505b0f-7448-4a73-8c26-b4aedf614304 req-bd84f8e3-139d-405e-b526-78214d61dedb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.747333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-84505b0f-7448-4a73-8c26-b4aedf614304 req-bd84f8e3-139d-405e-b526-78214d61dedb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.758430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-84505b0f-7448-4a73-8c26-b4aedf614304 req-bd84f8e3-139d-405e-b526-78214d61dedb service nova] Creating event network-vif-plugged:a0c164ca-6ded-4707-b14f-e26cae0a08e0 for instance d9d1406b-df8a-4eda-8814-e751b31b5d08 on hv-cinder-82549 Jun 02 09:16:03.763619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-84505b0f-7448-4a73-8c26-b4aedf614304 req-bd84f8e3-139d-405e-b526-78214d61dedb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028692 Jun 02 09:16:03.764195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 349/685] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:16:03.912478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:03.913186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:03.919787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.920263 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:03.921034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:03.921465 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:04.049336 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:04.056953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d1bc3f6b-4c5a-4013-a46d-2e6930a2e5bb tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1690 microversion: 2.1 time: 0.149826 Jun 02 09:16:04.057688 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 350/686] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:03 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:04.062332 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:04.063040 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:04.069504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:04.069960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:04.070733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:04.071185 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:04.201727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:04.209782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-203391da-c04f-419b-8a63-a05239983e7c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.151055 Jun 02 09:16:04.210348 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 351/687] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:04 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:05.074355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:05.074992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:05.081953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:05.082400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:05.083166 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:05.083628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:05.086300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:05.212149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:05.219353 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-65fec014-5901-48f0-873b-848ce15fd027 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1690 microversion: 2.1 time: 0.148787 Jun 02 09:16:05.219913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 352/688] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:05 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:05.226049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:05.226649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:05.232310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:05.232750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:05.233505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:05.233960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:05.359961 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:05.367193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4603df74-d294-4969-9836-e73ae34ee807 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.145301 Jun 02 09:16:05.367771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 353/689] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:05 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:06.236701 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:06.237283 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:06.244266 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:06.244716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:06.245480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:06.245918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:06.370146 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:06.377472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-df275747-d10a-4288-94ee-4a8ade0e6e3f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1690 microversion: 2.1 time: 0.144723 Jun 02 09:16:06.378048 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 354/690] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:06 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1690 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:06.435547 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:06.436172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:06.442203 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:06.442655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:06.443456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:06.443899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:06.574828 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:06.582927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-460804db-0195-4882-b008-7deaf32d83f0 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.203501 Jun 02 09:16:06.584027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 355/691] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:06 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:16:07.402800 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:07.404169 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:07.414855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:07.416446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:07.417425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:07.417977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:07.800219 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-351a0145-f698-49f3-afbd-ec0c6b0e8ea7 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "POST /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.318517 Jun 02 09:16:07.805578 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 337/692] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:16:03 2022] POST /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e/os-volume_attachments => generated 194 bytes in 4321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:16:07.806552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:07.807268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:07.814357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:07.814810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:07.816122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:07.816557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:07.945681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:07.954194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f6f83715-0b01-4d05-97e4-77885844680f tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1690 microversion: 2.1 time: 0.563923 Jun 02 09:16:07.956637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 356/693] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:07 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1690 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:08.069019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:08.076387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-95bffa01-1a99-4e2e-9214-d89c11a098f6 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.273952 Jun 02 09:16:08.076951 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 338/694] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:07 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:08.558854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-dba2fe18-59f3-49e5-aa8d-bd9050bceaeb req-b07237f6-555e-41c4-933f-a14873e799a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e5281e-07b3-4b55-8fb8-987b3ee1e875", "name": "network-vif-deleted", "tag": "b4d18847-4baf-4c0b-8f91-4df4a53d1e20"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:08.567520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-dba2fe18-59f3-49e5-aa8d-bd9050bceaeb req-b07237f6-555e-41c4-933f-a14873e799a9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:08.567968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-dba2fe18-59f3-49e5-aa8d-bd9050bceaeb req-b07237f6-555e-41c4-933f-a14873e799a9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:08.578967 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-dba2fe18-59f3-49e5-aa8d-bd9050bceaeb req-b07237f6-555e-41c4-933f-a14873e799a9 service nova] Creating event network-vif-deleted:b4d18847-4baf-4c0b-8f91-4df4a53d1e20 for instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 on hv-cinder-82549 Jun 02 09:16:08.584243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-dba2fe18-59f3-49e5-aa8d-bd9050bceaeb req-b07237f6-555e-41c4-933f-a14873e799a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028995 Jun 02 09:16:08.584850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 357/695] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:08.972837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:08.973450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:08.980080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:08.980528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:08.983469 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:08.983469 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:09.044580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:09.052059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-29e22bba-9952-475e-8314-770147f0275a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1331 microversion: 2.1 time: 0.083894 Jun 02 09:16:09.052625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 339/696] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:08 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1331 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:09.093816 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:09.094496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:09.101213 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:09.101693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:09.102467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:09.102899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:09.245410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:09.246042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f6eb1245-2705-45ff-a7fc-0a26761ae492 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1362 microversion: 2.1 time: 0.156468 Jun 02 09:16:09.246621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 358/697] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:09 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:10.068406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:10.069100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:10.075625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.076152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.076931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.077367 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.107980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.108428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.108870 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'fault' on Instance uuid 19e5281e-07b3-4b55-8fb8-987b3ee1e875 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:10.149718 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:10.157188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-74788b06-1577-40d6-8f1d-6dfa50b26f21 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 200 len: 1336 microversion: 2.1 time: 0.092536 Jun 02 09:16:10.157739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 340/698] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:10 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:10.264851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:10.265463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:10.272060 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.272504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.273271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.273704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.404557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:10.412790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3d6ad365-aa2c-45c6-96fe-7929d9ebbb53 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1548 microversion: 2.1 time: 0.152162 Jun 02 09:16:10.414011 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 359/699] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:10 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:10.428991 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:10.429489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:10.435570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.436022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.436823 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:10.437259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:10.522027 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a43843e4-abff-4659-9242-ce94f57f2912 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096908 Jun 02 09:16:10.522663 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 341/700] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:16:10 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:11.178401 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:11.179004 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 19e5281e-07b3-4b55-8fb8-987b3ee1e875] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:11.185249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:11.185692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:11.186490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:11.186918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:11.200589 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] HTTP exception thrown: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Request method failure captured: Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 HTTP/1.1 Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6w0b80vt-MQlcq-rUG7Y9zL3GFQiyXgT_4p4h71aQnB1saVZjqYoQ-CusqKGm-oyxy8HWoeWhhylre4Z1o4bfZdLw3mb2yE9nw9ROkdq2Ic4WU_Zm1PJWmj3fLCKU_nKSHEwdJjsh0EiEoKE-NwlFqX2b2EZNkfTvkMX42MEH8bkc Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:16:11.202228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1869e20213214111a0dfcda8b7abeecc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: bc0272ac06464fb7b430bc8c664208dd Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. Jun 02 09:16:11.203898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '19e5281e-07b3-4b55-8fb8-987b3ee1e875'} Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:16:11.205499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. Jun 02 09:16:11.207114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:11.208480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Returning 404 to user: Instance 19e5281e-07b3-4b55-8fb8-987b3ee1e875 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:16:11.208480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4195a60b-7099-4c2c-af05-f8d3736c747a tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875" status: 404 len: 111 microversion: 2.1 time: 0.029610 Jun 02 09:16:11.208480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 360/701] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:11 2022] GET /compute/v2.1/servers/19e5281e-07b3-4b55-8fb8-987b3ee1e875 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:16:11.211987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-940ac211-5ee2-4f03-96a8-047ccbb17339 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '.version_select at 0x7f967016aca0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:11.287530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-940ac211-5ee2-4f03-96a8-047ccbb17339 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003485134" status: 202 len: 0 microversion: 2.1 time: 0.079076 Jun 02 09:16:11.288111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 342/702] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 2 09:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003485134 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:16:11.467583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-6fafc894-7ea5-4531-9f4f-42d360509044 req-3f8ab7b1-3b3e-4537-bf15-974e38563c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d1406b-df8a-4eda-8814-e751b31b5d08", "tag": "a0c164ca-6ded-4707-b14f-e26cae0a08e0"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:11.472059 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:11.477344 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6fafc894-7ea5-4531-9f4f-42d360509044 req-3f8ab7b1-3b3e-4537-bf15-974e38563c1b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:11.477831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6fafc894-7ea5-4531-9f4f-42d360509044 req-3f8ab7b1-3b3e-4537-bf15-974e38563c1b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:11.490046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-6fafc894-7ea5-4531-9f4f-42d360509044 req-3f8ab7b1-3b3e-4537-bf15-974e38563c1b service nova] Creating event network-changed:a0c164ca-6ded-4707-b14f-e26cae0a08e0 for instance d9d1406b-df8a-4eda-8814-e751b31b5d08 on hv-cinder-82549 Jun 02 09:16:11.496109 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-6fafc894-7ea5-4531-9f4f-42d360509044 req-3f8ab7b1-3b3e-4537-bf15-974e38563c1b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031958 Jun 02 09:16:11.496894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 361/703] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:16:15.029040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:15.029530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:15.036734 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:15.037175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:15.037933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:15.038368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:15.062325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:16:15.309424 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a86660e1-364c-4f9c-8f4d-37a03e786ce0 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 204 len: 0 microversion: 2.1 time: 0.283854 Jun 02 09:16:15.310016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 343/704] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:16:15 2022] DELETE /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:16:15.319133 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:15.319863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:15.328065 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:15.328558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:15.332215 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:15.332215 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:15.458703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:15.466090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-18a2abce-efe4-45a9-9e49-9a12dfef5930 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1507 microversion: 2.1 time: 0.151828 Jun 02 09:16:15.466664 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 362/705] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:15 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:16.482202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:16.482897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:16.489401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:16.489786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:16.490541 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:16.490972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:16.862119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:16.869484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e5e36015-6819-421b-b5ef-87204248c5ab tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1507 microversion: 2.1 time: 0.391404 Jun 02 09:16:16.870035 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 344/706] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:16 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:17.886728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:17.887361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:17.894429 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:17.894873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:17.895652 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:17.896085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:18.030196 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:18.038447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-81a9340b-f721-4faf-8dc1-f2a8b71495a3 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1507 microversion: 2.1 time: 0.155782 Jun 02 09:16:18.039017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 363/707] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:17 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:18.920530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-61fae393-eb9b-4c18-acda-3040931d5e47 req-74ba86ba-13a8-49d6-9bc5-b0adf1976602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "985c0064-b00b-4cd5-8a5a-879b9c2b20a3", "name": "network-vif-deleted", "tag": "1ade0213-9d25-4fe3-9205-a852bd57287c"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:18.935384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-61fae393-eb9b-4c18-acda-3040931d5e47 req-74ba86ba-13a8-49d6-9bc5-b0adf1976602 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:18.939051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-61fae393-eb9b-4c18-acda-3040931d5e47 req-74ba86ba-13a8-49d6-9bc5-b0adf1976602 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:18.949372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-61fae393-eb9b-4c18-acda-3040931d5e47 req-74ba86ba-13a8-49d6-9bc5-b0adf1976602 service nova] Creating event network-vif-deleted:1ade0213-9d25-4fe3-9205-a852bd57287c for instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 on hv-cinder-82549 Jun 02 09:16:18.954376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-61fae393-eb9b-4c18-acda-3040931d5e47 req-74ba86ba-13a8-49d6-9bc5-b0adf1976602 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038768 Jun 02 09:16:18.955079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 345/708] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:19.055877 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:19.056463 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:19.063052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:19.063527 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:19.064312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:19.064750 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:19.126817 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:19.134654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b7dccd17-8e6c-4a41-b677-02b958115083 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1292 microversion: 2.1 time: 0.082694 Jun 02 09:16:19.135181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 364/709] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:19 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:20.153138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:20.153830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:20.165392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:20.165847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:20.166632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:20.167259 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:20.184864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:20.201289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:20.201727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:20.202169 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'fault' on Instance uuid 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:20.243341 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:20.250546 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c9bafde0-3078-47d2-bafe-dcbb9bac94d6 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1311 microversion: 2.1 time: 0.102078 Jun 02 09:16:20.251865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 346/710] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:20 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:21.267844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:21.269052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:21.275517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:21.275961 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:21.276718 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:21.277152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:21.306109 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:21.306549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:21.306987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'fault' on Instance uuid 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:21.350036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:21.357459 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ddcb192d-44b3-45cd-859b-9b12ab9fb2ff tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1311 microversion: 2.1 time: 0.093460 Jun 02 09:16:21.358016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 365/711] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:21 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:22.373956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:22.376289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:22.381763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:22.382218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:22.382979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:22.383441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:22.414710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:22.415207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:22.415689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'fault' on Instance uuid 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:22.459141 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:22.467033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-83798b76-c549-4abd-8cd5-fbec81098311 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 200 len: 1311 microversion: 2.1 time: 0.096967 Jun 02 09:16:22.467613 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 347/712] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:22 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:23.483639 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:23.484197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 985c0064-b00b-4cd5-8a5a-879b9c2b20a3] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:23.491353 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.495197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.495197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.495197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.506339 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] HTTP exception thrown: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Request method failure captured: Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 HTTP/1.1 Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6w0b80vt-MQlcq-rUG7Y9zL3GFQiyXgT_4p4h71aQnB1saVZjqYoQ-CusqKGm-oyxy8HWoeWhhylre4Z1o4bfZdLw3mb2yE9nw9ROkdq2Ic4WU_Zm1PJWmj3fLCKU_nKSHEwdJjsh0EiEoKE-NwlFqX2b2EZNkfTvkMX42MEH8bkc Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:16:23.508150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1869e20213214111a0dfcda8b7abeecc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: bc0272ac06464fb7b430bc8c664208dd Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. Jun 02 09:16:23.509695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '985c0064-b00b-4cd5-8a5a-879b9c2b20a3'} Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:16:23.510806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. Jun 02 09:16:23.512334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:23.513709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Returning 404 to user: Instance 985c0064-b00b-4cd5-8a5a-879b9c2b20a3 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:16:23.513709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c24687ff-5120-4b2f-ad1e-d566377733be tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3" status: 404 len: 111 microversion: 2.1 time: 0.030083 Jun 02 09:16:23.513709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 366/713] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:23 2022] GET /compute/v2.1/servers/985c0064-b00b-4cd5-8a5a-879b9c2b20a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:16:23.519043 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:23.519564 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:23.526086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.526537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.527329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.527777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.555745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:16:23.845630 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d4f799bc-eb55-4c4f-b25a-567d6e03d185 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 204 len: 0 microversion: 2.1 time: 0.330507 Jun 02 09:16:23.846215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 348/714] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:16:23 2022] DELETE /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:16:23.854666 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:23.855361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:23.861662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.862113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.862889 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:23.863367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:23.990487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:23.997968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-79027348-93f7-4f0e-8837-98d795ba9402 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.147122 Jun 02 09:16:23.998523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 367/715] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:23 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:25.015439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:25.016142 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:25.022624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:25.023071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:25.023874 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:25.024310 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:25.154214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:25.162343 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-087ebff1-7813-4165-880a-f70964a8f4e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.151088 Jun 02 09:16:25.163097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 349/716] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:25 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:26.179704 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:26.180232 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:26.187743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:26.188191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:26.188965 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:26.189403 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:26.316785 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:26.324735 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-96b5061d-0a53-4d2b-984b-7284fd58f5fd tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.149490 Jun 02 09:16:26.325301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 368/717] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:26 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:27.341444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:27.342036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:27.348462 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:27.348901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:27.349657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:27.350086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:27.480247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:27.487607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-09fd60a5-bc06-4bb6-9a60-e6d3dd395b89 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.149996 Jun 02 09:16:27.488167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 350/718] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:27 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:28.503604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:28.504227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:28.510966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:28.511461 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:28.512201 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:28.512633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:28.649719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:28.657261 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5cbadd2e-3811-4a2e-8847-0f18c83d6605 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.157507 Jun 02 09:16:28.657811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 369/719] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:28 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:29.674068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:29.674679 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:29.681877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:29.682320 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:29.683076 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:29.683533 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:29.810090 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:29.817457 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b726c667-0eca-4e2e-8e87-c8ae9c127099 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1521 microversion: 2.1 time: 0.147225 Jun 02 09:16:29.818012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 351/720] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:29 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:30.833991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:30.834638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:30.841128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:30.841635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:30.842446 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:30.842874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:30.940740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:30.948713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3b9baf37-c0c4-4a5f-a8e0-68b3f381448e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1479 microversion: 2.1 time: 0.118559 Jun 02 09:16:30.958159 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 370/721] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:30 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1479 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:30.958386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:30.958386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:30.958386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:30.958386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:30.959112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:30.959112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:31.020619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-6a7bb3a9-e212-4a9c-ae5a-80501d4f236a req-badcd19c-2563-4faf-ba01-307b10d2c2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cfeba25-7463-4c2e-a76e-8fb2dfaae97d", "name": "network-vif-deleted", "tag": "672e1526-26b2-4a56-8af6-7a2de997dc92"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:31.028988 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6a7bb3a9-e212-4a9c-ae5a-80501d4f236a req-badcd19c-2563-4faf-ba01-307b10d2c2b7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:31.029438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6a7bb3a9-e212-4a9c-ae5a-80501d4f236a req-badcd19c-2563-4faf-ba01-307b10d2c2b7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:31.032238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=100 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:31.043568 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lazy-loading 'services' on Instance uuid a7e85fc8-97fb-40cc-9dca-d80d7fadf34e {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:31.043746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-6a7bb3a9-e212-4a9c-ae5a-80501d4f236a req-badcd19c-2563-4faf-ba01-307b10d2c2b7 service nova] Creating event network-vif-deleted:672e1526-26b2-4a56-8af6-7a2de997dc92 for instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d on hv-cinder-82549 Jun 02 09:16:31.048630 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-6a7bb3a9-e212-4a9c-ae5a-80501d4f236a req-badcd19c-2563-4faf-ba01-307b10d2c2b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089364 Jun 02 09:16:31.049245 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 371/722] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:31.290612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-dcbd8908-486f-48a5-a1cf-05ef470762e8 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e/os-volume_attachments/07a81e46-f07a-4b12-8ed9-6cfe5e99835f" status: 202 len: 0 microversion: 2.1 time: 0.344269 Jun 02 09:16:31.291206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 352/723] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:16:30 2022] DELETE /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e/os-volume_attachments/07a81e46-f07a-4b12-8ed9-6cfe5e99835f => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:16:31.966278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:31.966978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:31.973398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:31.973850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:31.974616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:31.975053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:32.004838 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:32.005293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:32.005742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lazy-loading 'fault' on Instance uuid 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:32.046829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc0272ac06464fb7b430bc8c664208dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1869e20213214111a0dfcda8b7abeecc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:32.054614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-75280a33-aec1-4b7e-91fd-c0d9324bcc2e tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 200 len: 1311 microversion: 2.1 time: 0.093399 Jun 02 09:16:32.055168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 372/724] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:31 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:33.072263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:33.072962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] [instance: 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:33.074910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:33.079905 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.080361 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.081122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.081557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.095354 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] HTTP exception thrown: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Request method failure captured: Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d HTTP/1.1 Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6w0b80vt-MQlcq-rUG7Y9zL3GFQiyXgT_4p4h71aQnB1saVZjqYoQ-CusqKGm-oyxy8HWoeWhhylre4Z1o4bfZdLw3mb2yE9nw9ROkdq2Ic4WU_Zm1PJWmj3fLCKU_nKSHEwdJjsh0EiEoKE-NwlFqX2b2EZNkfTvkMX42MEH8bkc Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:16:33.096963 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1869e20213214111a0dfcda8b7abeecc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1869e20213214111a0dfcda8b7abeecc", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 1869e20213214111a0dfcda8b7abeecc Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-637293994 Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: bc0272ac06464fb7b430bc8c664208dd Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-ServerRescueNegativeTestJSON-637293994-project Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. Jun 02 09:16:33.099365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '9cfeba25-7463-4c2e-a76e-8fb2dfaae97d'} Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:16:33.100257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. Jun 02 09:16:33.102045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:33.103577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] Returning 404 to user: Instance 9cfeba25-7463-4c2e-a76e-8fb2dfaae97d could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:16:33.103577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ae37a38a-c0fe-4034-93bf-6826ef4d05e7 tempest-ServerRescueNegativeTestJSON-637293994 tempest-ServerRescueNegativeTestJSON-637293994-project] 10.222.0.18 "GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d" status: 404 len: 111 microversion: 2.1 time: 0.030832 Jun 02 09:16:33.103577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 353/725] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:33 2022] GET /compute/v2.1/servers/9cfeba25-7463-4c2e-a76e-8fb2dfaae97d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:16:33.460725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:33.461264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:33.468076 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.468640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.469429 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.469877 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.494562 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:16:33.744624 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d2cf75c0-427a-4a3e-b4e6-0ccf05ef3e77 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 204 len: 0 microversion: 2.1 time: 0.288387 Jun 02 09:16:33.745392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 373/726] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:16:33 2022] DELETE /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:16:33.760437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:33.761050 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:33.767292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.767739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.771820 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:33.771820 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:33.910121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:33.919051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-07cf1e40-813a-4afa-a1f4-098aa5c8cbb1 tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1514 microversion: 2.1 time: 0.162779 Jun 02 09:16:33.920017 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 354/727] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:33 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:34.937480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:34.939178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:34.946825 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:34.947525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:34.948295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:34.948725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:35.181901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:35.191600 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0206a151-2ead-40ed-bced-0e1cdbd5b84d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1514 microversion: 2.1 time: 0.258398 Jun 02 09:16:35.192958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 374/728] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:34 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:36.210609 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:36.211974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:36.219993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:36.220515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:36.221599 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:36.222174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:36.440919 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:36.449779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1c7ade66-392c-4aa7-869d-47c30c46b57c tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1514 microversion: 2.1 time: 0.243927 Jun 02 09:16:36.451106 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 355/729] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:36 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:36.699227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-3126b8bf-2301-4822-a108-36746005e222 req-1bf04e49-c05b-4ff9-8d77-57348ef2ff87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e85fc8-97fb-40cc-9dca-d80d7fadf34e", "name": "network-vif-deleted", "tag": "13effa59-07f8-46b9-9a61-b7d214f75eae"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:36.708748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3126b8bf-2301-4822-a108-36746005e222 req-1bf04e49-c05b-4ff9-8d77-57348ef2ff87 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:36.709194 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-3126b8bf-2301-4822-a108-36746005e222 req-1bf04e49-c05b-4ff9-8d77-57348ef2ff87 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:36.720681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-3126b8bf-2301-4822-a108-36746005e222 req-1bf04e49-c05b-4ff9-8d77-57348ef2ff87 service nova] Creating event network-vif-deleted:13effa59-07f8-46b9-9a61-b7d214f75eae for instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e on hv-cinder-82549 Jun 02 09:16:36.725808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-3126b8bf-2301-4822-a108-36746005e222 req-1bf04e49-c05b-4ff9-8d77-57348ef2ff87 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jun 02 09:16:36.726396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 375/730] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:37.466837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:37.467478 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:37.475719 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:37.476154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:37.477104 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:37.477873 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:37.509133 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:37.509306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:37.510565 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lazy-loading 'fault' on Instance uuid a7e85fc8-97fb-40cc-9dca-d80d7fadf34e {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:37.554784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2ce82718c341e8b1c321a2f128375d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5393c21cbc043318c9338c11264d29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:37.562183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-65aa9f49-8f81-4b1c-bd86-f4ce5b91e55f tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 200 len: 1309 microversion: 2.1 time: 0.099208 Jun 02 09:16:37.562742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 356/731] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:37 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:16:38.580264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:38.580973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] [instance: a7e85fc8-97fb-40cc-9dca-d80d7fadf34e] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:38.592884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:38.593417 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:38.594232 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:38.594672 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:38.608120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] HTTP exception thrown: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Request method failure captured: Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e HTTP/1.1 Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH9j9XcNSRlzav36eNkQ913H5IMYLtGWOjBHTDNwa9HUlg5GpYgjxTzCsklp1Q0MBf9v9HCA5c0MuRg7X7BvrYazIdfVmWtFQ85HloQMzezlqrsJ6xzaiWotrPdVOgLBPDPemItaGVzEsm_Xn3gsJWoVQxf_CSACTePTRMFK7i29eAE Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: c5393c21cbc043318c9338c11264d29d Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:16:38.609788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c5393c21cbc043318c9338c11264d29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c5393c21cbc043318c9338c11264d29d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: c5393c21cbc043318c9338c11264d29d Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-797723962 Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesSnapshotTestJSON-797723962-project Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: dd2ce82718c341e8b1c321a2f128375d Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesSnapshotTestJSON-797723962-project Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. Jun 02 09:16:38.611510 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'a7e85fc8-97fb-40cc-9dca-d80d7fadf34e'} Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:16:38.612488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. Jun 02 09:16:38.614023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:16:38.615227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] Returning 404 to user: Instance a7e85fc8-97fb-40cc-9dca-d80d7fadf34e could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:16:38.615227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-8cb020ff-9104-4d2a-b702-deaefd5ce72d tempest-VolumesSnapshotTestJSON-797723962 tempest-VolumesSnapshotTestJSON-797723962-project] 10.222.0.18 "GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e" status: 404 len: 111 microversion: 2.1 time: 0.035696 Jun 02 09:16:38.615227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 376/732] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:38 2022] GET /compute/v2.1/servers/a7e85fc8-97fb-40cc-9dca-d80d7fadf34e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:16:50.556091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1103477233"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:50.556604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:50.558654 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=9 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:50.559327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:50.564108 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:50.564555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:50.565325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:50.565760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:50.694484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.network.security_group_api [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Removing security group 3f75560f-3d5f-4e95-a5e0-d8a6d6492f78 from port 13aaa970-60b0-429e-a9cc-576740a99182 Jun 02 09:16:51.147155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-eca4b7ac-e27b-4fe0-97b9-1c2f4476920d tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action" status: 202 len: 0 microversion: 2.1 time: 0.594673 Jun 02 09:16:51.148986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 357/733] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:16:50 2022] POST /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:16:51.159376 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-83a51aac-c046-4025-8877-7402cd93fb47 req-7e476366-9bb0-4cf8-beb2-45384379f3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:51.165296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:51.165943 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:16:51.179277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-83a51aac-c046-4025-8877-7402cd93fb47 req-7e476366-9bb0-4cf8-beb2-45384379f3e2 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:51.190096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-83a51aac-c046-4025-8877-7402cd93fb47 req-7e476366-9bb0-4cf8-beb2-45384379f3e2 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:51.198884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-83a51aac-c046-4025-8877-7402cd93fb47 req-7e476366-9bb0-4cf8-beb2-45384379f3e2 service nova] Creating event network-changed:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:16:51.205725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-83a51aac-c046-4025-8877-7402cd93fb47 req-7e476366-9bb0-4cf8-beb2-45384379f3e2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049268 Jun 02 09:16:51.207832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 377/734] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:52.394336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:52.395026 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:52.404786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:52.409335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:52.409335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:52.409335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:52.500266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lazy-loading 'services' on Instance uuid d9941280-34e0-4798-9462-a46d5516c5e5 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:16:52.534991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-bb12b4e1-48f2-49ce-a770-7e3215e289d5 req-3ec9f37d-fa61-46a1-bc54-a2cb03d4eec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:16:52.543075 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-bb12b4e1-48f2-49ce-a770-7e3215e289d5 req-3ec9f37d-fa61-46a1-bc54-a2cb03d4eec7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:52.543569 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-bb12b4e1-48f2-49ce-a770-7e3215e289d5 req-3ec9f37d-fa61-46a1-bc54-a2cb03d4eec7 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:52.557398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-bb12b4e1-48f2-49ce-a770-7e3215e289d5 req-3ec9f37d-fa61-46a1-bc54-a2cb03d4eec7 service nova] Creating event network-changed:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:16:52.562349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-bb12b4e1-48f2-49ce-a770-7e3215e289d5 req-3ec9f37d-fa61-46a1-bc54-a2cb03d4eec7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170981 Jun 02 09:16:52.562932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 378/735] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:52.812262 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-05f3e5fd-3bde-4c77-a9ec-4a009c5348c8 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments/8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe" status: 202 len: 0 microversion: 2.1 time: 0.422976 Jun 02 09:16:52.816786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 358/736] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:16:52 2022] DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments/8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:16:52.823049 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:52.824175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:52.830921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:52.831623 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:52.832396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:52.833029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:52.863939 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0ee81ee2-182c-4a0f-b6cc-e51414db05a3 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Jun 02 09:16:52.864504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 379/737] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:52 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:16:53.876840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:53.877919 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:53.884842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:53.885535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:53.886317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:53.886748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:53.914981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-993749b3-caa8-4e83-bc84-de8c2c080584 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 Jun 02 09:16:53.915568 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 359/738] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:53 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:54.928812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:54.929730 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:54.935601 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:54.936098 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:54.936898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:54.937327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:54.967523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d53a849a-e86d-42b2-bad1-21ea6cbb06f6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Jun 02 09:16:54.968074 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 380/739] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:54 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:55.979493 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:55.980526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:55.986999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:55.991368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:55.991368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:55.991368 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:56.017077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4a82fbc5-bf49-4dc1-8624-5e67892525e7 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Jun 02 09:16:56.017622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 360/740] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:55 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:16:57.028652 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:57.029571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:57.035985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:57.036425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:57.037226 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:57.037685 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:57.065491 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9931d919-f047-403c-9bc3-17b4d5e3c4bd tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040767 Jun 02 09:16:57.066574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 381/741] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:16:57 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:16:57.076264 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:57.076809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:57.083188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:57.083657 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:57.084412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:57.084840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:57.158478 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] HTTP exception thrown: Instance d9941280-34e0-4798-9462-a46d5516c5e5 is not attached to volume 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Request method failure captured: Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments/8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe HTTP/1.1 Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH9IVKAjrrLky3Ab93l2ioDv7ZDbmhblNvK2OTIpwVg8atktsWhwWYuhvZZeZvmJ-219bHIiUQB7vcbJdzm7lAbaEVvg86JYHtzGXoM-e_DiY_bzHfiPTD28fx7KsRul6MLbnk1Yp9b9mGV-hZE7cM9e7Bow3P56EJpvkd3DSjtvEJg Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: eb2c902507914576a1d06ba54a87df1d Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:16:57.168725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb2c902507914576a1d06ba54a87df1d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: eb2c902507914576a1d06ba54a87df1d Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-TestMinimumBasicScenario-978473192-project Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 12293a5616e2410fb173a0b4424e63ff Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-TestMinimumBasicScenario-978473192-project Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:16:57.170410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance d9941280-34e0-4798-9462-a46d5516c5e5 is not attached to volume 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'server_id': 'd9941280-34e0-4798-9462-a46d5516c5e5', 'id': '8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe'} Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe. Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:16:57.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9941280-34e0-4798-9462-a46d5516c5e5 is not attached to volume 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9941280-34e0-4798-9462-a46d5516c5e5 is not attached to volume 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:16:57.173197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Returning 404 to user: Instance d9941280-34e0-4798-9462-a46d5516c5e5 is not attached to volume 8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:16:57.174311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-165490d2-48b1-43d8-8aa2-6c467127ff71 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments/8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe" status: 404 len: 154 microversion: 2.1 time: 0.099212 Jun 02 09:16:57.174311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 361/742] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:16:57 2022] DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5/os-volume_attachments/8b19c8e3-cac7-4e4f-ac01-f37cd67ef5fe => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:16:58.535408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:58.536525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:58.542960 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.543582 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:58.544651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.544761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:58.550796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:58.551342 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:58.557557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.558304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:58.559380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.559966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:58.571978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:16:58.585634 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6238968a-b190-4187-b0f2-1369b4121b4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/ips" status: 200 len: 152 microversion: 2.20 time: 0.203933 Jun 02 09:16:58.586868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 382/743] 10.222.0.18 () {60 vars in 1288 bytes} [Thu Jun 2 09:16:58 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/ips => generated 152 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:16:58.869492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b190f7d9-450e-47ca-88c1-c14882ad02c6 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 204 len: 0 microversion: 2.1 time: 0.337563 Jun 02 09:16:58.870437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 362/744] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:16:58 2022] DELETE /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 09:16:58.878696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:16:58.880006 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:16:58.886087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.886535 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:58.887334 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:16:58.887832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:16:59.029380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:16:59.036812 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-194dc278-afc1-4183-923c-df0695ae087b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1555 microversion: 2.1 time: 0.161916 Jun 02 09:16:59.037408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 383/745] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:16:58 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:00.054684 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:00.055336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:00.061753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:00.062208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:00.062977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:00.063458 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:00.198634 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:00.206589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0a228ac1-d033-4370-8fc2-f45b9f7336d0 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1555 microversion: 2.1 time: 0.156178 Jun 02 09:17:00.207151 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 363/746] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:00 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:00.791691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:00.792252 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:00.798747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:00.799199 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:00.805022 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:00.805022 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:00.825369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lazy-loading 'flavor' on Instance uuid 26809f37-aa49-4fd4-b039-3a2f9452ab78 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:17:01.224640 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:01.225251 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:01.233037 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:01.233620 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:01.234422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:01.234851 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:01.431962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-37f7458e-0317-45a2-9c9c-9405a96d0149 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/action" status: 202 len: 0 microversion: 2.20 time: 0.644674 Jun 02 09:17:01.436189 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 384/747] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 2 09:17:00 2022] POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 02 09:17:01.444622 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:01.445017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:01.449574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:01.451536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:01.451987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:01.452763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:01.453195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:01.461445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-087f9e59-087c-4eee-8ef0-b325e2b54718 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1555 microversion: 2.1 time: 0.240797 Jun 02 09:17:01.462015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 364/748] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:01 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:01.620524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:01.665479 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:01.665479 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:01.665479 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-50af600c-8bd6-4849-afce-da890cdd4831 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.199466 Jun 02 09:17:01.666304 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 385/749] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:01 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:01.676332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-99060d37-812d-49f4-a2b6-d5018ff5318f req-67046a37-394d-4229-b445-e57a4da6e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9941280-34e0-4798-9462-a46d5516c5e5", "name": "network-vif-deleted", "tag": "13aaa970-60b0-429e-a9cc-576740a99182"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:01.684299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-99060d37-812d-49f4-a2b6-d5018ff5318f req-67046a37-394d-4229-b445-e57a4da6e4c5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:01.688043 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-99060d37-812d-49f4-a2b6-d5018ff5318f req-67046a37-394d-4229-b445-e57a4da6e4c5 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:01.696293 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-99060d37-812d-49f4-a2b6-d5018ff5318f req-67046a37-394d-4229-b445-e57a4da6e4c5 service nova] Creating event network-vif-deleted:13aaa970-60b0-429e-a9cc-576740a99182 for instance d9941280-34e0-4798-9462-a46d5516c5e5 on hv-cinder-82549 Jun 02 09:17:01.701479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-99060d37-812d-49f4-a2b6-d5018ff5318f req-67046a37-394d-4229-b445-e57a4da6e4c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028784 Jun 02 09:17:01.702068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 365/750] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:02.478788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:02.479355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:02.485654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:02.486117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:02.487094 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:02.487561 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:02.520077 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:02.520524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:02.520976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lazy-loading 'fault' on Instance uuid d9941280-34e0-4798-9462-a46d5516c5e5 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:17:02.564864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12293a5616e2410fb173a0b4424e63ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2c902507914576a1d06ba54a87df1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:02.572439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e81b148e-6f78-4483-b1ed-70c9ead7c9c2 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 200 len: 1348 microversion: 2.1 time: 0.098143 Jun 02 09:17:02.573009 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 386/751] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:02 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:17:02.659173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:02.660041 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:02.666778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:02.667346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:02.668193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:02.668725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:02.801986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:02.809922 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:02.811450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:02.812599 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6b2da6e1-8271-4e18-b070-cef80874a308 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.158325 Jun 02 09:17:02.813208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 366/752] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:02 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:03.589506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:03.590114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] [instance: d9941280-34e0-4798-9462-a46d5516c5e5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:03.597231 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:03.597677 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:03.598590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:03.599073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:03.612920 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] HTTP exception thrown: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Request method failure captured: Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 HTTP/1.1 Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH9IVKAjrrLky3Ab93l2ioDv7ZDbmhblNvK2OTIpwVg8atktsWhwWYuhvZZeZvmJ-219bHIiUQB7vcbJdzm7lAbaEVvg86JYHtzGXoM-e_DiY_bzHfiPTD28fx7KsRul6MLbnk1Yp9b9mGV-hZE7cM9e7Bow3P56EJpvkd3DSjtvEJg Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: eb2c902507914576a1d06ba54a87df1d Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:17:03.614597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eb2c902507914576a1d06ba54a87df1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eb2c902507914576a1d06ba54a87df1d", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: eb2c902507914576a1d06ba54a87df1d Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-TestMinimumBasicScenario-978473192 Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-TestMinimumBasicScenario-978473192-project Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 12293a5616e2410fb173a0b4424e63ff Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-TestMinimumBasicScenario-978473192-project Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. Jun 02 09:17:03.616758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'd9941280-34e0-4798-9462-a46d5516c5e5'} Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:03.617563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. Jun 02 09:17:03.618949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:03.623407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Returning 404 to user: Instance d9941280-34e0-4798-9462-a46d5516c5e5 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:03.623407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c3c2ea91-b3f1-4999-9b3b-810b0b60c224 tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5" status: 404 len: 111 microversion: 2.1 time: 0.030329 Jun 02 09:17:03.623407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 387/753] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:03 2022] GET /compute/v2.1/servers/d9941280-34e0-4798-9462-a46d5516c5e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:03.625662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7a6b3e46-fc88-4bf9-908f-341c3a440c1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] Calling method '.version_select at 0x7f9670134e50>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:03.732342 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7a6b3e46-fc88-4bf9-908f-341c3a440c1b tempest-TestMinimumBasicScenario-978473192 tempest-TestMinimumBasicScenario-978473192-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-975867841" status: 202 len: 0 microversion: 2.1 time: 0.110889 Jun 02 09:17:03.736115 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 367/754] 10.222.0.18 () {58 vars in 1268 bytes} [Thu Jun 2 09:17:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-975867841 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:17:03.831061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:03.831717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:03.837888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:03.838326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:03.839101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:03.839561 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:03.972903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:03.981859 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:03.985617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:03.985617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7d53f1cb-c17a-4b47-9216-cfb98454700e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.157385 Jun 02 09:17:03.985617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 388/755] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:03 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:05.004480 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:05.005081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:05.012977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:05.013427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:05.014198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:05.014627 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:05.067745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:05.068327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:05.076503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:05.077474 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:05.078518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:05.079193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:05.113157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9d2a085d-dbf6-4fa2-afb4-cefa97887504 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/ips" status: 200 len: 146 microversion: 2.1 time: 0.049317 Jun 02 09:17:05.113853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 389/756] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:17:05 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:17:05.171347 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:05.180075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:05.185496 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:05.185496 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bbfe77f1-2da3-451e-915e-6cc3e668adb3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.182832 Jun 02 09:17:05.185496 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 368/757] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:04 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:06.201464 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:06.202455 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:06.209274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:06.209791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:06.210577 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:06.211019 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:06.368777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:06.378487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:06.380112 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:06.381350 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d8172672-22a6-48a2-8578-4fa3f4700bf4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.184028 Jun 02 09:17:06.381897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 390/758] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:06 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:06.761439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e9e0985-7d60-4ddc-a080-b0b526921101"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:06.763292 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:06.769125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:06.769665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:06.770500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:06.771022 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:07.400410 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:07.401128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:07.410005 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:07.413650 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:07.414485 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:07.414931 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:07.563947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9743ce3e-0428-42a2-97c8-171413caa296 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806518 Jun 02 09:17:07.565056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 369/759] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:17:06 2022] POST /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:07.714256 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:07.722810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:07.724319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:07.725847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d6aa25f7-1370-439c-a5b6-dc4c8551dd6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.329409 Jun 02 09:17:07.735293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 391/760] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:07 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:17:08.748610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:08.749908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:08.757952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:08.758631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:08.759632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:08.760469 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:09.106515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:09.115088 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:09.116768 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:09.118129 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-83dfbec7-e60f-4f88-826f-88cc9f058b68 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.374798 Jun 02 09:17:09.118693 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 370/761] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:08 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:10.136679 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:10.137255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:10.144354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:10.144802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:10.145586 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:10.146026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:10.336179 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:10.342852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:10.344402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:10.345606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cf543642-5d56-49a4-85c7-bb0defb02a4e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.213400 Jun 02 09:17:10.346161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 392/762] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:10 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:11.364112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:11.364722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:11.373501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:11.374184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:11.375118 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:11.375743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:11.871654 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:11.875369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:11.882572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:11.884407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:11.885909 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9bb6a8ea-e584-4b9a-8dc1-70e5f6201854 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.525844 Jun 02 09:17:11.893656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 371/763] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:11 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:12.904390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:12.905089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:12.912407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:12.912851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:12.913668 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:12.914502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:13.164915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:13.168545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:13.173438 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:13.175026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:13.176254 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-80004717-0341-4493-aa96-19a4191dc7b7 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.275690 Jun 02 09:17:13.176810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 393/764] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:12 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:14.195482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:14.196093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:14.203087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:14.203639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:14.204416 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:14.204870 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:14.337372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:14.345290 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:14.347011 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:14.348193 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7623148d-dfc8-4f0e-a1dc-81340601fe29 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.156950 Jun 02 09:17:14.348742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 372/765] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:14 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:15.366571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:15.367186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:15.374406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:15.374853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:15.375660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:15.376103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:15.546638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:15.554777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:15.556294 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:15.557453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f588f75d-d14f-4de4-87be-eb13b4259dce tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.195452 Jun 02 09:17:15.558007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 394/766] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:15 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:16.576112 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:16.576722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:16.583370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:16.583828 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:16.584593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:16.585034 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:16.711246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:16.719334 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:16.720856 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:16.722005 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a1873e66-5b13-4a4a-a636-10bf6c74c9c2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.150120 Jun 02 09:17:16.722558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 373/767] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:16 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:17.268956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:17.269979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:17.277033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.277486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.278260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.278699 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.308686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2c7754e3-de20-4b61-be35-7f6b5ed3f02e tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Jun 02 09:17:17.309239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 395/768] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:17:17 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:17.319555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:17.320140 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:17.326223 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.326685 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.327482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.327918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.356215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b074d552-912c-4d24-ba73-90724dc1bf6c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101" status: 200 len: 194 microversion: 2.1 time: 0.041050 Jun 02 09:17:17.361086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 374/769] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 2 09:17:17 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:17:17.744810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:17.745424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:17.751461 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.751915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.755788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:17.755788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:17.888267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:17.896546 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:17.898123 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:17.899372 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7c47429e-e945-424e-8743-0c37f00dac6d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1745 microversion: 2.20 time: 0.158925 Jun 02 09:17:17.899923 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 396/770] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:17 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:18.922633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:18.923389 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:18.929915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:18.930365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:18.931131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:18.931594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:19.003663 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0d60399-d79e-4c35-af0e-0b6b80f4e855"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:19.005106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:19.013441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:19.014161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:19.015183 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:19.015736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:19.078233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:19.087260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:19.088752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:19.089898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-72e66534-fc61-41cc-b3da-ade7dca059bd tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1745 microversion: 2.20 time: 0.171247 Jun 02 09:17:19.090826 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 375/771] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:18 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:19.711458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-15844cf9-0242-4e2c-867c-e4dfd48e402a tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "POST /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712122 Jun 02 09:17:19.712072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 397/772] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:17:18 2022] POST /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:20.109255 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:20.110007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:20.117746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:20.118287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:20.119270 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:20.122416 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:20.274135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:20.284222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:20.285946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:20.287307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-84167c3f-977b-473e-a869-39e21d358a58 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.182814 Jun 02 09:17:20.299975 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 376/773] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:20 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:21.306660 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:21.307297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:21.315981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:21.321797 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:21.322420 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:21.323408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:21.324284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:21.481026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-60ba434f-27bb-442e-a1f3-05c8ccbd0ed9 req-178612ed-5c0a-46bc-8752-41e31456ba4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "name": "network-vif-plugged", "status": "completed", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:21.502507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-60ba434f-27bb-442e-a1f3-05c8ccbd0ed9 req-178612ed-5c0a-46bc-8752-41e31456ba4b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:21.506997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-60ba434f-27bb-442e-a1f3-05c8ccbd0ed9 req-178612ed-5c0a-46bc-8752-41e31456ba4b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:21.527499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-60ba434f-27bb-442e-a1f3-05c8ccbd0ed9 req-178612ed-5c0a-46bc-8752-41e31456ba4b service nova] Creating event network-vif-plugged:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:17:21.534255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-60ba434f-27bb-442e-a1f3-05c8ccbd0ed9 req-178612ed-5c0a-46bc-8752-41e31456ba4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.361866 Jun 02 09:17:21.535907 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 398/774] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:21.561441 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:21.573779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:21.576001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:21.577329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b57a75b7-0e26-40b5-8e44-1ed3b6fa0935 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.274826 Jun 02 09:17:21.578149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 377/775] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:21 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:17:22.597536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:22.598671 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:22.606584 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:22.607027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:22.607827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:22.608433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:22.786990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:22.797369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:22.799122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:22.800733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b5306c94-8728-4ac8-89cb-1f468e04d32a tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.208787 Jun 02 09:17:22.801593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 399/776] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:22 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:23.821603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:23.822206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:23.829757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:23.830443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:23.831477 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:23.832289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:24.040799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:24.060249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:24.061885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:24.063184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b476cd9d-1d49-47d1-ac38-0369af732a7d tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.246715 Jun 02 09:17:24.069012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 378/777] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:23 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:25.083767 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:25.085501 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:25.088267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=49 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:25.095832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:25.096277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:25.097056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:25.097491 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:25.338434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:25.351435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:25.353279 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:25.355423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1a60e747-99a2-4421-94f7-034733ababb6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.274890 Jun 02 09:17:25.358868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 400/778] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:25 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:26.374443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:26.375061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:26.386800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:26.387274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:26.389902 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:26.390347 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:26.587326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:26.595692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:26.601598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:26.605311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1bc32f16-f677-4e1d-a0d9-18dab241ec16 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.235289 Jun 02 09:17:26.608178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 379/779] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:26 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:27.624834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:27.625434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:27.632042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:27.632496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:27.633271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:27.633708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.059901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:28.086568 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:28.088842 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:28.095087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-317a0a24-9945-4d4a-9bcf-0bb78f499e5c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.474054 Jun 02 09:17:28.099116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 401/780] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:27 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:28.452990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:28.455530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:28.467816 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.468365 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.469233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.469913 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.512414 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6665ef3c-fe12-4e4a-8255-cf2f35924d92 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064438 Jun 02 09:17:28.513355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 380/781] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:17:28 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:28.668660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:28.669086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:28.675745 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.676230 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.677087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.677756 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.730557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e292343b-a9db-4ced-837d-dc089142d3fe tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101" status: 200 len: 194 microversion: 2.1 time: 0.074490 Jun 02 09:17:28.731860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 402/782] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 2 09:17:28 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:28.741967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:28.743397 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:28.749974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.750425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.751340 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:28.751771 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:28.871100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lazy-loading 'services' on Instance uuid d9d1406b-df8a-4eda-8814-e751b31b5d08 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:17:29.117424 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:29.118053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:29.131086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:29.131578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:29.132402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:29.132851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:29.148418 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6c57f10a-35fa-454d-a57f-005e6011ba62 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101" status: 202 len: 0 microversion: 2.1 time: 0.411002 Jun 02 09:17:29.149330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 381/783] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:17:28 2022] DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/1e9e0985-7d60-4ddc-a080-b0b526921101 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:17:29.676250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:29.690245 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:29.692394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:29.694141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-601e807f-3484-4ec4-85d4-fe86a33c3678 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.581019 Jun 02 09:17:29.694829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 403/784] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:29 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:30.712338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:30.713068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:30.737322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:30.742309 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:30.743594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:30.744222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:30.906313 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:30.928800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:30.931857 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:30.933467 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ffdd8d20-e6bc-4bb6-bcba-5eb8d714eb17 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.225522 Jun 02 09:17:30.934585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 382/785] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:30 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:31.413380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:31.414287 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:31.422661 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.423414 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:31.424645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.425297 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:31.463956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4a88f9c9-eb71-41a8-8976-e7cb9011a3da tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/d0d60399-d79e-4c35-af0e-0b6b80f4e855" status: 200 len: 194 microversion: 2.1 time: 0.062415 Jun 02 09:17:31.464560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 404/786] 10.222.0.18 () {58 vars in 1412 bytes} [Thu Jun 2 09:17:31 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/d0d60399-d79e-4c35-af0e-0b6b80f4e855 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:31.474482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:31.475662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:31.481803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.482361 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:31.483144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.483625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:31.577085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lazy-loading 'services' on Instance uuid d9d1406b-df8a-4eda-8814-e751b31b5d08 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:17:31.958368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:31.960448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6b05fe23-c714-4ad5-ac9b-16c6e046604b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/d0d60399-d79e-4c35-af0e-0b6b80f4e855" status: 202 len: 0 microversion: 2.1 time: 0.487898 Jun 02 09:17:31.960883 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:31.960966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 383/787] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:17:31 2022] DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments/d0d60399-d79e-4c35-af0e-0b6b80f4e855 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:17:31.967649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.968103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:31.968884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:31.969312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:32.153593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:32.167942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:32.169442 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:32.171521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-251ff744-c3e8-4a1e-a92e-a49d17d575f2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.216637 Jun 02 09:17:32.185316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 405/788] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:31 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:17:33.197466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:33.198362 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:33.213881 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:33.214953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:33.215928 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:33.216376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:33.445272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:33.455563 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:33.457646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:33.459164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c4bd4002-d10c-477a-95ff-fdcc0552b1d3 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1740 microversion: 2.20 time: 0.268418 Jun 02 09:17:33.460383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 384/789] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:33 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:34.218271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:34.219333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:34.226395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.226846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.227845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.228448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.274591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-04ab6923-e953-4315-a72f-f089310c5f8d tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060195 Jun 02 09:17:34.279863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 406/790] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:17:34 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:17:34.391935 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:34.393035 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:34.407339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.407976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.409068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.409678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.446838 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b35734e2-da22-4b8e-b2c6-48a0b78ed6d8 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059082 Jun 02 09:17:34.451732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 385/791] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:17:34 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:17:34.478148 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:34.478879 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:34.485442 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.486277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.487138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.487762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.510682 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:34.511188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:34.518028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.518350 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.519153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:34.519621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:34.709681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:17:34.733668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:34.755113 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:34.768125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:34.771573 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:34.771573 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1ef8ff45-878b-43a4-bb06-bcd2186b1bec tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1722 microversion: 2.20 time: 0.297346 Jun 02 09:17:34.783159 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 407/792] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:34 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:35.017917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6e20e2a7-0ee2-47fa-b88f-8b4b3306e2b3 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 204 len: 0 microversion: 2.1 time: 0.510527 Jun 02 09:17:35.017917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 386/793] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:17:34 2022] DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:17:35.026319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:35.027104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:35.033942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:35.034498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:35.035433 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:35.035937 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:35.187723 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:35.198979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c495803f-a3f2-4cbf-888a-0772f3721485 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1673 microversion: 2.1 time: 0.175874 Jun 02 09:17:35.201953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 408/794] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:35 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:17:35.792348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:35.793674 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:35.801179 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:35.801886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:35.803012 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:35.803772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:35.964070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:35.973781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:35.976001 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:35.977268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a9d67dc6-76c7-4288-9fc1-1a53935871b4 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1722 microversion: 2.20 time: 0.189296 Jun 02 09:17:35.978257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 387/795] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:35 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:36.218305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:36.222459 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:36.226238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:36.226698 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:36.227505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:36.227942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:36.382240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:36.386379 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:36.392327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3a3c1e1f-6856-41ac-a113-fdf4c81a72f1 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1673 microversion: 2.1 time: 0.177450 Jun 02 09:17:36.392861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 409/796] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:36 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:17:37.005329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:37.005978 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:37.013504 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:37.013968 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:37.014778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:37.015302 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:37.232146 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:37.242064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:37.247589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:37.251574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-04321b29-4dff-413c-945b-1b9ce69f5077 req-e096fd08-6436-4a6e-bad6-089ccf5db4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "name": "network-vif-unplugged", "status": "completed", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:37.256723 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-279bfeba-047b-4da8-8ce2-fcd364806d57 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1722 microversion: 2.20 time: 0.250171 Jun 02 09:17:37.256723 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 388/797] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:37 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:37.265844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-04321b29-4dff-413c-945b-1b9ce69f5077 req-e096fd08-6436-4a6e-bad6-089ccf5db4bd service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:37.266606 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-04321b29-4dff-413c-945b-1b9ce69f5077 req-e096fd08-6436-4a6e-bad6-089ccf5db4bd service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:37.280932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-04321b29-4dff-413c-945b-1b9ce69f5077 req-e096fd08-6436-4a6e-bad6-089ccf5db4bd service nova] Creating event network-vif-unplugged:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:17:37.287772 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-04321b29-4dff-413c-945b-1b9ce69f5077 req-e096fd08-6436-4a6e-bad6-089ccf5db4bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041483 Jun 02 09:17:37.288688 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 410/798] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:37.409852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:37.410610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:37.418960 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:37.419451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:37.420234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:37.420672 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:37.569016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:37.581349 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-851c9c4e-575e-4405-bc4b-901289abd899 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1673 microversion: 2.1 time: 0.175210 Jun 02 09:17:37.582172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 389/799] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:37 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:37.639863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ed625c36-efdf-41a7-826f-6e3636aaed02 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Action: 'create', calling method: .version_select at 0x7f9670488dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1041487610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQVINPiy7OE3m82x0TFcjm7/gPQjfv4JrcfbU/+uNRNTnZ21pPMCx8yB9nv5Nf0KxyV+TbgIxWySa7nCPSgsL+s9e/f4e9lQiBSDpWBCVYUxXNNnIXDLvsLkqfeFqDdMg=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:37.654769 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-ed625c36-efdf-41a7-826f-6e3636aaed02 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Getting quotas for project 5ec06218a20940509976a1e656176d9b. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:17:37.658837 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-ed625c36-efdf-41a7-826f-6e3636aaed02 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Getting quotas for user 5d38aab25eca47c888d3add258ce3cff and project 5ec06218a20940509976a1e656176d9b. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:17:37.754502 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ed625c36-efdf-41a7-826f-6e3636aaed02 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.304828 Jun 02 09:17:37.759085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 411/800] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:17:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:38.270052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:38.270789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:38.277374 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:38.277825 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:38.278595 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:38.279030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:38.408370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:38.417184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:38.418690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:38.419911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-00b26a48-3358-4c1e-bbe4-59358cc3f77c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1722 microversion: 2.20 time: 0.153742 Jun 02 09:17:38.420581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 390/801] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:38 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:38.601490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:38.602473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:38.610932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:38.616621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:38.616621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:38.616621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:38.757395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:38.763440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1ae7d295-f4c2-4766-9958-7ffcaecae862 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1673 microversion: 2.1 time: 0.167516 Jun 02 09:17:38.764435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 412/802] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:38 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:17:39.437920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:39.438532 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:39.446058 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.449972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.452021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.452021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.678837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:39.687677 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:39.689238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:39.690529 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f06576dc-d0a0-4693-9054-4eb4d895db93 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1725 microversion: 2.20 time: 0.256483 Jun 02 09:17:39.695404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 391/803] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:39 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:39.713277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f280b77a-2d4e-4c8a-a479-04cd8b0f4faa"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:39.714359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:39.722091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.722865 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.723921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.724611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.781767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:39.782641 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:39.794625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.795214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.807987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:39.808611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:39.985092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:40.004569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a13082f2-b988-4fbd-b811-a8d4b793d123 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1605 microversion: 2.1 time: 0.226671 Jun 02 09:17:40.016604 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 392/804] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:39 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:40.079998 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-3dba1325-97a0-4504-a5e8-28b3507cf439 req-902193f5-e43c-4543-8fe7-c5524faace7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d1406b-df8a-4eda-8814-e751b31b5d08", "name": "network-vif-deleted", "tag": "a0c164ca-6ded-4707-b14f-e26cae0a08e0"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:40.091509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-3dba1325-97a0-4504-a5e8-28b3507cf439 req-902193f5-e43c-4543-8fe7-c5524faace7c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:40.091509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-3dba1325-97a0-4504-a5e8-28b3507cf439 req-902193f5-e43c-4543-8fe7-c5524faace7c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:40.108381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-3dba1325-97a0-4504-a5e8-28b3507cf439 req-902193f5-e43c-4543-8fe7-c5524faace7c service nova] Creating event network-vif-deleted:a0c164ca-6ded-4707-b14f-e26cae0a08e0 for instance d9d1406b-df8a-4eda-8814-e751b31b5d08 on hv-cinder-82549 Jun 02 09:17:40.124386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-3dba1325-97a0-4504-a5e8-28b3507cf439 req-902193f5-e43c-4543-8fe7-c5524faace7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044915 Jun 02 09:17:40.131905 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 393/805] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:17:41.022934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:41.023729 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:41.036885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:41.036885 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:41.037678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:41.038376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:41.076090 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:41.076542 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:41.077003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lazy-loading 'fault' on Instance uuid d9d1406b-df8a-4eda-8814-e751b31b5d08 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:17:41.105987 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e0de57a1-9c30-46cc-8598-cc4f28ece00c tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.396828 Jun 02 09:17:41.111532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 413/806] 10.222.0.18 () {62 vars in 1363 bytes} [Thu Jun 2 09:17:39 2022] POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments => generated 188 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 09:17:41.137351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89a238fc8047cdaaac1047a675cfbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597dc461d8a042e19ad99324a626aac1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:41.154953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4312d3bf-93b4-429f-bf9b-328fdb505328 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 200 len: 1326 microversion: 2.1 time: 0.136648 Jun 02 09:17:41.155794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 394/807] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:41 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:17:41.339649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:41.344090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:41.352040 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:41.352834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:41.354168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:41.354717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.008709 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-11512651-295f-4f1e-bb02-9aeda2a3f312 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments/f280b77a-2d4e-4c8a-a479-04cd8b0f4faa" status: 202 len: 0 microversion: 2.20 time: 0.676682 Jun 02 09:17:42.009326 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 414/808] 10.222.0.18 () {60 vars in 1456 bytes} [Thu Jun 2 09:17:41 2022] DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments/f280b77a-2d4e-4c8a-a479-04cd8b0f4faa => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:17:42.069695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:42.070262 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:42.076850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.077291 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.078209 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.078646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.172958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:42.173692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:42.180041 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.180497 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.181283 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.181723 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.198360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 HTTP/1.1 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:17:42.200543 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:42.202205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'd9d1406b-df8a-4eda-8814-e751b31b5d08'} Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:42.203138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:42.207692 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:42.209997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:42.209997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-642c006b-a7d5-4d87-a22f-d14ddf2c099b tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 404 len: 111 microversion: 2.1 time: 0.036137 Jun 02 09:17:42.209997 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 415/809] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:42 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:17:42.214656 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-da33522c-455c-4d96-b524-f4e71568ad18 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '.version_select at 0x7f96704cd820>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:42.320125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-da33522c-455c-4d96-b524-f4e71568ad18 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25083928" status: 202 len: 0 microversion: 2.1 time: 0.109098 Jun 02 09:17:42.320642 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 416/810] 10.222.0.18 () {58 vars in 1214 bytes} [Thu Jun 2 09:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25083928 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:17:42.432993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-88537f54-b670-4e32-9cdd-31ecdf4dd239 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/action" status: 202 len: 0 microversion: 2.20 time: 0.367699 Jun 02 09:17:42.436820 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 395/811] 10.222.0.18 () {62 vars in 1318 bytes} [Thu Jun 2 09:17:42 2022] POST /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:17:42.441818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:42.442498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:42.450958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.451518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.452384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:42.453025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:42.617468 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:42.639860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:42.641771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:42.642985 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-629c1290-b037-4b4b-9588-4d5d24cbb9a2 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1673 microversion: 2.20 time: 0.205084 Jun 02 09:17:42.644244 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 417/812] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:42 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:43.665916 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:43.667263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:43.673633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:43.674172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:43.675025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:43.675633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:43.812406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:43.824464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:43.826333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:43.827564 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-558163e4-e77f-43f5-82ae-54a44b1eac15 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1673 microversion: 2.20 time: 0.169568 Jun 02 09:17:43.828115 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 396/813] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:43 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:44.847627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:44.851138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:44.860011 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:44.860705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:44.861493 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:44.861928 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:45.057370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:45.065376 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:45.066856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:45.068530 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2cadb351-5a0f-4fd2-b0ee-e744bbb20df6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.225709 Jun 02 09:17:45.069096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 418/814] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:44 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:45.895589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:45.896098 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:45.902781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:45.903244 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:45.904036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:45.904477 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:45.918081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 HTTP/1.1 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:17:45.919931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.921201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': 'd9d1406b-df8a-4eda-8814-e751b31b5d08'} Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:45.921925 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.923138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.924419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:45.924419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-613a63be-d15c-4f58-bca9-4ac0a7bf91b5 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 404 len: 111 microversion: 2.1 time: 0.029560 Jun 02 09:17:45.928892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 397/815] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:17:45 2022] DELETE /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:45.931077 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:45.931806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: d9d1406b-df8a-4eda-8814-e751b31b5d08] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:45.938831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:45.939249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:45.940047 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:45.940487 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:45.957678 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 HTTP/1.1 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:17:45.959286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.960787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'd9d1406b-df8a-4eda-8814-e751b31b5d08'} Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:45.961621 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. Jun 02 09:17:45.963089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:45.964466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance d9d1406b-df8a-4eda-8814-e751b31b5d08 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:45.964466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e3d1fef8-586d-4178-bbc1-b334b5132eef tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08" status: 404 len: 111 microversion: 2.1 time: 0.034116 Jun 02 09:17:45.964466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 419/816] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:45 2022] GET /compute/v2.1/servers/d9d1406b-df8a-4eda-8814-e751b31b5d08 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:46.086921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:46.087521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:46.093528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:46.093969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:46.094720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:46.095523 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:46.255555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:46.264993 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:46.266793 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:46.269072 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4d2b30b0-36aa-4e4c-88c3-602e2a0e3b99 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.186114 Jun 02 09:17:46.270347 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 398/817] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:46 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:47.215167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:47.215722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:47.222490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.222936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.223768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.224200 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.238177 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 HTTP/1.1 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:17:47.240284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.242419 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'b19073d8-fcec-4ea0-945a-c532266bf751'} Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:47.243574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.244790 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.245989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:47.245989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-81e80727-06dc-4f44-b1d7-4f9d2cdc3cc9 tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 404 len: 111 microversion: 2.1 time: 0.030371 Jun 02 09:17:47.245989 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 420/818] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:17:47 2022] DELETE /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:47.251279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:47.252245 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] [instance: b19073d8-fcec-4ea0-945a-c532266bf751] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:47.259152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.259912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.260696 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.261195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.281803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] HTTP exception thrown: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Request method failure captured: Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 HTTP/1.1 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6q30NzuupdamtLEVjJKoMXiWKuEFfadORSXFJYNDOZWP1pjvOU8-_CET6p-BS1EIQfT0JfZFxQ7MJo-H0edf07p074W80J475nCZghso97xAFokEc-cH5ca3GFMsGyKTxxMK5PXCDHUUlNxTkjggUw2P2o5u5mdVeu4lbrTRzIqq4 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:17:47.283388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/597dc461d8a042e19ad99324a626aac1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_597dc461d8a042e19ad99324a626aac1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 597dc461d8a042e19ad99324a626aac1 Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeTestJSON-273944895 Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 0d89a238fc8047cdaaac1047a675cfbb Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeTestJSON-273944895-project Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.284852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': 'b19073d8-fcec-4ea0-945a-c532266bf751'} Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:47.289575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. Jun 02 09:17:47.291033 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:17:47.292386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] Returning 404 to user: Instance b19073d8-fcec-4ea0-945a-c532266bf751 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:47.292386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4ce7ebe7-0783-4d9c-a698-1a94a024305c tempest-AttachVolumeTestJSON-273944895 tempest-AttachVolumeTestJSON-273944895-project] 10.222.0.18 "GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751" status: 404 len: 111 microversion: 2.1 time: 0.037451 Jun 02 09:17:47.292386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 399/819] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:47 2022] GET /compute/v2.1/servers/b19073d8-fcec-4ea0-945a-c532266bf751 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:47.299383 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:47.299886 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:47.307305 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.307752 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.308896 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:47.309019 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:47.595371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:47.604187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:47.605943 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:47.607409 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-83ddfae2-026c-41d8-9497-f896fc4110d8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.321198 Jun 02 09:17:47.618960 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 421/820] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:47 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:17:48.625799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:48.627062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:48.634317 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:48.635314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:48.636312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:48.636907 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:48.795835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:48.807311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:48.809134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:48.810788 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-edf98f75-a0ea-4e8d-b4b6-7f3032764b3b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.188838 Jun 02 09:17:48.811896 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 400/821] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:48 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:49.830888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:49.832329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:49.834990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=4 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:49.845684 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:49.846147 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:49.848385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:49.848385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:50.125393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:50.135101 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:50.135917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:50.137095 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-252bdcaa-673a-4be2-a145-795d330e9ee0 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.311105 Jun 02 09:17:50.153030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 422/822] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:49 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:51.171800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:51.173319 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:51.198472 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:51.203206 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:51.204520 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:51.205355 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:51.514366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:51.528369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:51.529860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:51.531224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-67256f60-3a4c-4076-9acf-faa26072e86b tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.375520 Jun 02 09:17:51.546869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 401/823] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:51 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:52.554186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:52.554902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:52.561758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:52.562274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:52.563144 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:52.563831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:52.753003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:52.757477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:52.759352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:52.761034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1237fbfb-2bed-4e5a-8069-6cc5b62b7164 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.210948 Jun 02 09:17:52.761595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 423/824] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:52 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:53.783603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:53.784755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:53.795114 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:53.795938 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:53.797000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:53.801254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:53.961453 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:53.965020 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:53.969781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:53.971287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:53.972527 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a1fdc2a9-7615-4137-a367-4aad9d239e23 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.195573 Jun 02 09:17:53.973543 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 402/825] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:53 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:54.992097 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:54.992774 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:54.994921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:55.000025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:55.000463 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:55.001322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:55.001751 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:55.043444 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-63f31198-e66c-48d6-b7bd-964ae83a7b0d tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Action: 'create', calling method: .version_select at 0x7f9670200af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-112404915", "metadata": {"Type": "work"}}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:55.137724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:55.146174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:55.147674 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:55.148889 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c379bb13-50c8-4008-94ab-dff1dc5606d6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.161957 Jun 02 09:17:55.149493 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 403/826] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:54 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:17:55.678214 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-63f31198-e66c-48d6-b7bd-964ae83a7b0d tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.748939 Jun 02 09:17:55.678845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 424/827] 10.222.0.18 () {60 vars in 1155 bytes} [Thu Jun 2 09:17:54 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 750 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 09:17:55.690158 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9df8e344-80f1-4a6c-a967-63f142679116 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f9670166a60>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:55.743398 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9df8e344-80f1-4a6c-a967-63f142679116 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 200 len: 352 microversion: 2.1 time: 0.054008 Jun 02 09:17:55.743398 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 404/828] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:17:55 2022] GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:56.166883 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:56.167518 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:56.169392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:17:56.174884 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:56.175359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:56.176121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:56.177048 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:56.306945 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:56.314964 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:56.316604 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:56.317746 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1e3f6b2c-543e-47b3-bdef-f15deeb34669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.155464 Jun 02 09:17:56.318293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 425/829] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:56 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:56.752756 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7f4a9ca5-d76f-4820-ac8e-b992abbbc0a9 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f967016a9d0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:56.798619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7f4a9ca5-d76f-4820-ac8e-b992abbbc0a9 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 200 len: 353 microversion: 2.1 time: 0.050143 Jun 02 09:17:56.799179 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 405/830] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:17:56 2022] GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:56.810466 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b515b8f6-7467-437b-b207-01afed849379 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f9670587c10>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:56.855869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b515b8f6-7467-437b-b207-01afed849379 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 200 len: 353 microversion: 2.1 time: 0.049399 Jun 02 09:17:56.856434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 426/831] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:17:56 2022] GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:56.871753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ce72f9a6-4243-4f45-bea6-c04c9cee7f61 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f967030f430>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:57.047780 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ce72f9a6-4243-4f45-bea6-c04c9cee7f61 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 202 len: 0 microversion: 2.1 time: 0.179626 Jun 02 09:17:57.048343 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 406/832] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:17:56 2022] DELETE /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:17:57.056259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b72b0a98-9658-4981-a02a-7b151bfd3206 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f96705c21f0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:57.101347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b72b0a98-9658-4981-a02a-7b151bfd3206 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 200 len: 352 microversion: 2.1 time: 0.048830 Jun 02 09:17:57.101905 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 427/833] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:17:57 2022] GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:17:57.336357 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:57.336998 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:57.343021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:57.344598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:57.344598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:57.344784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:57.479132 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:57.488236 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:57.490217 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:57.491417 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-92bdb61b-c819-46ca-a415-e4ad03c3e669 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.159517 Jun 02 09:17:57.492122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 407/834] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:57 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:58.115192 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a7accbf8-80fb-46eb-927b-1793f4b96136 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Calling method '.version_select at 0x7f96704780d0>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:58.142561 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-a7accbf8-80fb-46eb-927b-1793f4b96136 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] HTTP exception thrown: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a7accbf8-80fb-46eb-927b-1793f4b96136 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Request method failure captured: Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d HTTP/1.1 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimIBCEboJIsLGPE3oe8Xc0jvPyIEEYlUDDaEfXiyxjHaM1o67Qs6pk1Ps_lQacd3QxKneVdcOi5iHLw86J0qnnnC4KEgOC_ljY13hMSuaEcVofDjyBTKFhXA5_xY3sRXrjh4n84PWqAvudt8NwFIAExKkFmHgqwztpWGg82-p4T5i8z8 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 0ada9dbfe85843f7bf57d78f5949c061 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-VolumesGetTestJSON-2044162975 Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:17:58.144557 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0ada9dbfe85843f7bf57d78f5949c061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0ada9dbfe85843f7bf57d78f5949c061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0ada9dbfe85843f7bf57d78f5949c061"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0ada9dbfe85843f7bf57d78f5949c061", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-VolumesGetTestJSON-2044162975 Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 0ada9dbfe85843f7bf57d78f5949c061 Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-VolumesGetTestJSON-2044162975 Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-VolumesGetTestJSON-2044162975-project Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 3c2f667f7ece4c58a12924c734a2e6a2 Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-VolumesGetTestJSON-2044162975-project Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '01f07e41-fbf1-4670-9d41-00cd530f464d'} Jun 02 09:17:58.146733 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. (HTTP 404) (Request-ID: req-7cb619d2-cdd5-478d-a75d-77a4c1eb7615) Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:58.147858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 09:17:58.149551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 09:17:58.151030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a7accbf8-80fb-46eb-927b-1793f4b96136 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] Returning 404 to user: Volume 01f07e41-fbf1-4670-9d41-00cd530f464d could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a7accbf8-80fb-46eb-927b-1793f4b96136 tempest-VolumesGetTestJSON-2044162975 tempest-VolumesGetTestJSON-2044162975-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d" status: 404 len: 109 microversion: 2.1 time: 0.036366 Jun 02 09:17:58.157801 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 428/835] 10.222.0.18 () {58 vars in 1244 bytes} [Thu Jun 2 09:17:58 2022] GET /compute/v2.1/os-volumes/01f07e41-fbf1-4670-9d41-00cd530f464d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:17:58.509865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:58.510573 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:58.517786 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:58.521234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:58.521234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:58.521234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:58.546428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1739840546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1041487610", "security_groups": [{"name": "tempest-secgroup-smoke-772472870"}], "networks": [{"uuid": "9360ff25-c9fc-451f-baca-030b69d4c7b5"}], "block_device_mapping_v2": [{"uuid": "c9ee2c7f-1817-455a-94ac-d97991ce3cda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:58.697972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:58.705899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:58.707431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:58.709234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cdf2cfb5-060b-44c4-9eb1-559e0d355694 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.203613 Jun 02 09:17:58.709795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 408/836] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:58 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:17:58.713321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] validate_networks() for [('9360ff25-c9fc-451f-baca-030b69d4c7b5', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:17:59.198580 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:17:59.199171 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:17:59.199703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:17:59.200672 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:17:59.200999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:17:59.210728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:59.211347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:59.212758 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:59.214125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:59.232895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Getting quotas for project 5ec06218a20940509976a1e656176d9b. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:17:59.237356 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Getting quotas for user 5d38aab25eca47c888d3add258ce3cff and project 5ec06218a20940509976a1e656176d9b. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:17:59.298105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:17:59.300490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9ee2c7f-1817-455a-94ac-d97991ce3cda',volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:17:59.332039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-694fbc1b-6d74-4bee-a836-f78527aa06f7 req-1ebd9bec-f5be-4ba6-a7e5-cc30066f6aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "name": "network-vif-plugged", "status": "completed", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:17:59.340182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-694fbc1b-6d74-4bee-a836-f78527aa06f7 req-1ebd9bec-f5be-4ba6-a7e5-cc30066f6aa9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:59.340739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-694fbc1b-6d74-4bee-a836-f78527aa06f7 req-1ebd9bec-f5be-4ba6-a7e5-cc30066f6aa9 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:59.352438 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-694fbc1b-6d74-4bee-a836-f78527aa06f7 req-1ebd9bec-f5be-4ba6-a7e5-cc30066f6aa9 service nova] Creating event network-vif-plugged:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:17:59.359936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-694fbc1b-6d74-4bee-a836-f78527aa06f7 req-1ebd9bec-f5be-4ba6-a7e5-cc30066f6aa9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 Jun 02 09:17:59.360647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 409/837] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:17:59.731497 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:59.732336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:59.739872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:59.740318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:59.741087 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:17:59.741552 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:17:59.821221 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-784ab067-59ec-4c24-abdc-8aae2488f1cc tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.278860 Jun 02 09:17:59.824320 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 429/838] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:17:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 09:17:59.835152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ce72a8e8-7067-4e61-878a-742038a5f875 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:17:59.836064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ce72a8e8-7067-4e61-878a-742038a5f875 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:17:59.928084 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ce72a8e8-7067-4e61-878a-742038a5f875 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:59.936385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ce72a8e8-7067-4e61-878a-742038a5f875 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1089 microversion: 2.1 time: 0.106446 Jun 02 09:17:59.937029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 430/839] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:17:59 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1089 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:17:59.984725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:59.995427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:59.997218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:17:59.998379 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2ac2fffc-ea42-4167-ae8c-1f440aa2f07f tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.273635 Jun 02 09:17:59.998924 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 410/840] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:17:59 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:00.953310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:00.953911 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:00.962583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:00.965560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:00.965560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:00.965560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:01.017521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:01.017521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:01.024801 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:01.025260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:01.026046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:01.026481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:01.026612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:01.028670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:01.034592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5e769694-8f69-44b1-9f26-8f4cd7e4c376 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1139 microversion: 2.1 time: 0.085057 Jun 02 09:18:01.035163 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 431/841] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:00 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:01.168187 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:01.178025 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:01.179673 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:01.180863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e4ac4654-4dec-40e0-9835-d64e6645c4a8 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.167982 Jun 02 09:18:01.181425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 411/842] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:01 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 09:18:02.051816 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:02.052456 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:02.059638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:02.064647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:02.064647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:02.064647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:02.123279 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:02.130724 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a828ec4e-601e-41e7-99fb-1bb85a547a34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1187 microversion: 2.1 time: 0.082691 Jun 02 09:18:02.131309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 432/843] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:02 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:02.199094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:02.199740 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:02.206666 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:02.207120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:02.214849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:02.214849 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:02.381152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:02.389758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:02.391267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:02.392424 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a04745f1-5994-404e-b0db-655af197bd78 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1731 microversion: 2.20 time: 0.197278 Jun 02 09:18:02.393106 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 412/844] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:02 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:03.148500 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:03.149131 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:03.156488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:03.156944 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:03.157724 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:03.158164 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:03.226595 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:03.236156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-73d14d45-6d19-4917-96cb-b07931123721 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1205 microversion: 2.1 time: 0.091788 Jun 02 09:18:03.237116 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 433/845] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:03 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:03.412239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:03.412880 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:03.419846 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:03.420303 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:03.421086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:03.421531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:03.618770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:03.628452 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:03.630176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:03.631722 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4327f61f-08cf-4f95-aff9-5640f82f4c3e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1718 microversion: 2.20 time: 0.224155 Jun 02 09:18:03.632458 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 413/846] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:03 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:04.257270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:04.257974 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:04.269966 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:04.278175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:04.281002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:04.281587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:04.428549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:04.436741 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bae8ce60-58cf-40f2-9182-12dda85a5fe7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.187356 Jun 02 09:18:04.444202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 434/847] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:04 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:04.471555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-b2fdbb98-981b-4346-bd40-f2fa731965bd req-29356e5b-f7ba-44b1-8752-bdfe04972258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:18:04.482045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-b2fdbb98-981b-4346-bd40-f2fa731965bd req-29356e5b-f7ba-44b1-8752-bdfe04972258 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:04.482608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-b2fdbb98-981b-4346-bd40-f2fa731965bd req-29356e5b-f7ba-44b1-8752-bdfe04972258 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:04.495465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-b2fdbb98-981b-4346-bd40-f2fa731965bd req-29356e5b-f7ba-44b1-8752-bdfe04972258 service nova] Creating event network-changed:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:18:04.501163 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-b2fdbb98-981b-4346-bd40-f2fa731965bd req-29356e5b-f7ba-44b1-8752-bdfe04972258 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040673 Jun 02 09:18:04.505855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 414/848] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:18:05.455853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:05.456928 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:05.464637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:05.467636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:05.467636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:05.467636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:05.707908 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:05.715611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-445725a2-e4eb-4419-9bb5-9d09320130f6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.264177 Jun 02 09:18:05.716191 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 435/849] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:05 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:18:06.740501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:06.741239 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:06.747602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:06.748061 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:06.748837 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:06.749281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:06.882685 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:06.890517 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a08295c3-bdd9-47af-b7e1-50b62ea4e333 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.154621 Jun 02 09:18:06.891148 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 415/850] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:06 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:07.907618 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:07.908236 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:07.914695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:07.915195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:07.915998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:07.916441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:08.047708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:08.055675 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-696c22b2-20fb-4e94-b013-6c6cdf807bec tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.151865 Jun 02 09:18:08.056233 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 436/851] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:07 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:09.073160 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:09.073772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:09.080534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:09.081013 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:09.081760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:09.082235 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:09.287999 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:09.295647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ca8b0e02-1200-4733-9bd8-1048d99e7de7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.226342 Jun 02 09:18:09.296197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 416/852] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:09 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:18:10.313448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:10.314061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:10.316388 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:10.317195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=8 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:10.321907 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:10.322361 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:10.324891 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:10.324891 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:10.452255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:10.460197 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-87b50be9-d761-454b-8ef3-568ad62951ff tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.150558 Jun 02 09:18:10.460751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 437/853] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:10 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:11.476836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:11.477497 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:11.483988 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:11.484431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:11.485185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:11.485615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:11.874366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:11.882353 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5e1e764b-1045-4900-b2b4-90a4ea1bab31 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.409384 Jun 02 09:18:11.882899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 417/854] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:11 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:12.898834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:12.899478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:12.905992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:12.906473 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:12.907258 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:12.907713 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:13.048341 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:13.056455 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f420e9e3-d5fe-4bf7-92bc-b514006f0dea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.161447 Jun 02 09:18:13.057027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 438/855] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:12 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:14.073260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:14.073872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:14.080276 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:14.080725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:14.081490 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:14.081928 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:14.213468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:14.220802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ce0d1bfe-ce95-4b4b-aebc-96dd6f781d3a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.151320 Jun 02 09:18:14.221356 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 418/856] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:14 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:15.237258 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:15.237875 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:15.244402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:15.244851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:15.245622 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:15.246063 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:15.372427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:15.380338 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-35e433fb-8275-48f0-abc5-ee0f334bdb6a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.146993 Jun 02 09:18:15.380898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 439/857] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:15 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:16.397917 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:16.398522 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:16.404754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:16.405207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:16.405972 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:16.406407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:16.539809 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:16.547678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-fd83b8ea-ed9f-450d-ae66-6ee6aa90929e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.154276 Jun 02 09:18:16.548249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 419/858] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:16 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:17.564509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:17.565175 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:17.572209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:17.572677 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:17.573475 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:17.573913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:17.706330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:17.713885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ccdb2809-7ede-4990-be93-9d6fb9b242e5 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.153365 Jun 02 09:18:17.714445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 440/859] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:17 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:18.401570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-e5de7801-3d02-4b17-bffc-882f30423b24 req-2815e01c-b002-4579-a14c-915e10af4dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "name": "network-vif-plugged", "status": "completed", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:18:18.411100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e5de7801-3d02-4b17-bffc-882f30423b24 req-2815e01c-b002-4579-a14c-915e10af4dfe service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:18.411622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e5de7801-3d02-4b17-bffc-882f30423b24 req-2815e01c-b002-4579-a14c-915e10af4dfe service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:18.423142 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-e5de7801-3d02-4b17-bffc-882f30423b24 req-2815e01c-b002-4579-a14c-915e10af4dfe service nova] Creating event network-vif-plugged:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:18:18.428082 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-e5de7801-3d02-4b17-bffc-882f30423b24 req-2815e01c-b002-4579-a14c-915e10af4dfe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Jun 02 09:18:18.428667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 420/860] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:18:18.730434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:18.730967 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:18.737563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:18.743391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:18.743391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:18.743391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:18.931849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:18.950008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5db16ab8-96d3-4e94-bd3b-1b29c80d5442 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.212844 Jun 02 09:18:18.950008 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 441/861] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:18 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:19.962548 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:19.963269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:19.969560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:19.970009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:19.970772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:19.971203 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:20.102880 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:20.108178 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d52969b3-24d2-4f14-a5e7-99fb30d65c34 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.150452 Jun 02 09:18:20.108737 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 421/862] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:19 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:21.125234 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:21.125869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:21.133128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:21.133575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:21.134626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:21.135058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:21.267952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:21.277856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-53cf8760-0ba7-4b95-80fd-4385df869c8a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.156387 Jun 02 09:18:21.278421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 442/863] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:21 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:22.294707 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:22.295327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:22.301787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:22.302233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:22.303068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:22.303537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:22.433269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:22.440864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a0277ad3-fbaf-4f05-8017-e91d4769aa84 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1260 microversion: 2.1 time: 0.150202 Jun 02 09:18:22.441426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 422/864] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:22 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:23.456832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:23.457436 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:23.463939 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:23.464327 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:23.465085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:23.465516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:23.595115 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:23.603386 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e8262890-8d44-4f69-a716-a41655a4c7db tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1444 microversion: 2.1 time: 0.150295 Jun 02 09:18:23.603952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 443/865] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:23 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:23.620167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:23.620778 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:23.627422 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:23.627964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:23.628757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:23.629204 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:23.763304 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:23.771901 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cde08e12-8c95-4ccc-9ced-7fc71d3be628 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1444 microversion: 2.1 time: 0.155486 Jun 02 09:18:23.772489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 423/866] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:18:23 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:25.771007 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-962899ac-8b84-4d75-ba6c-f3342b1a3ee2 req-b7e45a51-a587-4e32-b70d-04866ec66f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:18:25.779524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-962899ac-8b84-4d75-ba6c-f3342b1a3ee2 req-b7e45a51-a587-4e32-b70d-04866ec66f93 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:25.779962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-962899ac-8b84-4d75-ba6c-f3342b1a3ee2 req-b7e45a51-a587-4e32-b70d-04866ec66f93 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:25.791188 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-962899ac-8b84-4d75-ba6c-f3342b1a3ee2 req-b7e45a51-a587-4e32-b70d-04866ec66f93 service nova] Creating event network-changed:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:18:25.799786 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-962899ac-8b84-4d75-ba6c-f3342b1a3ee2 req-b7e45a51-a587-4e32-b70d-04866ec66f93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 Jun 02 09:18:25.800553 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 444/867] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:18:43.425298 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:43.426249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:43.428863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=35 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:43.429521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=96 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:43.434218 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.434664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:43.435467 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.440710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:43.464898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-66fe81df-aba7-4ca6-b196-f4397b717805 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043611 Jun 02 09:18:43.467105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 424/868] 10.222.0.18 () {60 vars in 1342 bytes} [Thu Jun 2 09:18:43 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:18:43.523682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:43.524435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=75 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:18:43.528488 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:43.529071 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:43.535002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.535486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:43.536250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.536689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:43.560870 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:18:43.865225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ca364228-084a-42ea-beeb-90d1a3513dfe tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 204 len: 0 microversion: 2.20 time: 0.343357 Jun 02 09:18:43.868390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 445/869] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 2 09:18:43 2022] DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 09:18:43.874373 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:43.874974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:43.881896 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.882956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:43.883747 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:43.884454 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:44.020287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:44.028182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:44.030103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:44.030807 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-01cc4b44-c8b4-4608-b37e-2f631414872e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.160296 Jun 02 09:18:44.031384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 425/870] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:43 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:45.049775 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:45.050399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:45.056942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:45.057389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:45.058157 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:45.058591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:45.192846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:45.201532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:45.203023 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:45.204201 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-328ca5aa-8b9b-4c66-b150-322b9e4d1cfc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1724 microversion: 2.20 time: 0.158788 Jun 02 09:18:45.204764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 446/871] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:45 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:46.224118 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:46.226692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:46.233710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:46.234152 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:46.234960 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:46.235494 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:46.314862 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:46.323007 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:46.324560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:46.325742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d6e1e7a5-b099-49fe-848b-1b7250a2cc14 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1656 microversion: 2.20 time: 0.105973 Jun 02 09:18:46.326615 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 426/872] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:46 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:46.432810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-6c857aaf-6681-4e4e-b413-a2e7476a44e4 req-e95b86ec-c42e-44e3-85ad-4537e3968a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26809f37-aa49-4fd4-b039-3a2f9452ab78", "name": "network-vif-deleted", "tag": "7cf1db89-11df-4fd7-8cdc-d443cf9a6a52"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:18:46.448693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6c857aaf-6681-4e4e-b413-a2e7476a44e4 req-e95b86ec-c42e-44e3-85ad-4537e3968a0d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:46.449228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-6c857aaf-6681-4e4e-b413-a2e7476a44e4 req-e95b86ec-c42e-44e3-85ad-4537e3968a0d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:46.463864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-6c857aaf-6681-4e4e-b413-a2e7476a44e4 req-e95b86ec-c42e-44e3-85ad-4537e3968a0d service nova] Creating event network-vif-deleted:7cf1db89-11df-4fd7-8cdc-d443cf9a6a52 for instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 on hv-cinder-82549 Jun 02 09:18:46.469391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-6c857aaf-6681-4e4e-b413-a2e7476a44e4 req-e95b86ec-c42e-44e3-85ad-4537e3968a0d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040969 Jun 02 09:18:46.470431 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 447/873] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:18:47.343848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:47.344970 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:47.352703 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:47.353161 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:47.353946 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:47.354610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:47.394816 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:47.396623 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:47.397086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lazy-loading 'fault' on Instance uuid 26809f37-aa49-4fd4-b039-3a2f9452ab78 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:18:47.446281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:47.457057 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:47.458556 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58b706e007fa46c7b8a69508455fcdba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a81b035f834106b49c35c847f246d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:18:47.460000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-99a8839d-ee20-4853-b9b7-f49f756257d1 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 200 len: 1371 microversion: 2.20 time: 0.120113 Jun 02 09:18:47.463036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 427/874] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:47 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 09:18:48.478927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:48.479643 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:48.485874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:48.486323 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:48.487093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:48.487555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:48.501021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 HTTP/1.1 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:18:48.502706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:48.504559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '26809f37-aa49-4fd4-b039-3a2f9452ab78'} Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:18:48.505498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:48.507949 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:48.509631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:18:48.509631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9b46482f-6850-45e6-b0f3-e2c3052bfcb5 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 404 len: 111 microversion: 2.20 time: 0.029829 Jun 02 09:18:48.509631 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 448/875] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:48 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:18:48.513929 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6fb2eae1-3646-4865-9a91-3ac5d6e4db87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '.version_select at 0x7f967029d1f0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:48.592143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6fb2eae1-3646-4865-9a91-3ac5d6e4db87 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213653854" status: 204 len: 0 microversion: 2.20 time: 0.081653 Jun 02 09:18:48.593224 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 428/876] 10.222.0.18 () {60 vars in 1261 bytes} [Thu Jun 2 09:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213653854 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 09:18:50.586799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:50.587405 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:50.593876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:50.594318 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:50.595085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:50.595552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:50.609236 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 HTTP/1.1 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:18:50.610794 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.612552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '26809f37-aa49-4fd4-b039-3a2f9452ab78'} Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:18:50.613377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.614582 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.615852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:18:50.615852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f53593b6-dcf6-4203-a883-8754f51065c6 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 404 len: 111 microversion: 2.20 time: 0.029840 Jun 02 09:18:50.615852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 449/877] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 2 09:18:50 2022] DELETE /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:18:50.621254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:50.621864 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 26809f37-aa49-4fd4-b039-3a2f9452ab78] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:50.628934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:50.629383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:50.630144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:50.630580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:50.644000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 HTTP/1.1 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:18:50.645655 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.647792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '26809f37-aa49-4fd4-b039-3a2f9452ab78'} Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:18:50.648701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. Jun 02 09:18:50.650185 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:50.651668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 26809f37-aa49-4fd4-b039-3a2f9452ab78 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:18:50.651668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9d15f748-56ae-4dc1-b05d-2c2ca307a3dc tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78" status: 404 len: 111 microversion: 2.20 time: 0.029682 Jun 02 09:18:50.651668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 429/878] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:50 2022] GET /compute/v2.1/servers/26809f37-aa49-4fd4-b039-3a2f9452ab78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 09:18:51.905847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:51.906411 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:51.913099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:51.914062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:51.914835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:51.915290 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:51.929873 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f HTTP/1.1 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:18:51.931426 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.933180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '02b7a340-7dfe-47ad-b8c2-3caa63dda45f'} Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:18:51.934255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.935846 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.937567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:18:51.937567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4fbce40b-4b31-4251-b019-5575a9e0039e tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 404 len: 111 microversion: 2.20 time: 0.031099 Jun 02 09:18:51.937567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 450/879] 10.222.0.18 () {60 vars in 1279 bytes} [Thu Jun 2 09:18:51 2022] DELETE /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:18:51.941388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:18:51.942028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] [instance: 02b7a340-7dfe-47ad-b8c2-3caa63dda45f] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:18:51.948715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:51.949167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:51.949949 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:18:51.950390 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:18:51.964179 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] HTTP exception thrown: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Request method failure captured: Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f HTTP/1.1 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimH6wx-qjRW1umi3BONO-POipp7j1BuXXR-NRpcBveAstJ_P1IPeB2c5kwljP5YU5ukzO40ei5b07f9eISMSezmypdTjnyInnyx9YtYMU3CyZimyqpwjoWBL1BjkXPmFo_kswXaeHIx2PNAGq2lpBxW5xoiAJr3QOmMTQGS7PZlaQyww Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:18:51.965753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24a81b035f834106b49c35c847f246d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24a81b035f834106b49c35c847f246d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24a81b035f834106b49c35c847f246d6", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 24a81b035f834106b49c35c847f246d6 Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692206108 Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 58b706e007fa46c7b8a69508455fcdba Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692206108-project Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.967489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '02b7a340-7dfe-47ad-b8c2-3caa63dda45f'} Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:18:51.968580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. Jun 02 09:18:51.970466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:18:51.972137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] Returning 404 to user: Instance 02b7a340-7dfe-47ad-b8c2-3caa63dda45f could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:18:51.972137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0e2d16e5-89ce-46d8-a209-3bd176614817 tempest-AttachVolumeShelveTestJSON-1692206108 tempest-AttachVolumeShelveTestJSON-1692206108-project] 10.222.0.18 "GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f" status: 404 len: 111 microversion: 2.20 time: 0.029570 Jun 02 09:18:51.972137 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 430/880] 10.222.0.18 () {60 vars in 1276 bytes} [Thu Jun 2 09:18:51 2022] GET /compute/v2.1/servers/02b7a340-7dfe-47ad-b8c2-3caa63dda45f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:19:02.786736 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:02.787506 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:02.897724 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-aa3fd296-42f8-4cb6-a320-064743133067 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: .version_select at 0x7f9670654040>, body: {"keypair": {"name": "tempest-keypair-1703961789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwP1VDijzy6vDScpE2CrDJfC2EFs4idIUu9ECP+vYF8ewWa3aILxAVyqBP4O+aRGN7K8ul0FtsKbWyo9FPe/KX9M2psfyP/0DtEZIOGdLCipeVq6YvpdXR36OW15afNXQ=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:19:02.914380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-aa3fd296-42f8-4cb6-a320-064743133067 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:19:02.918816 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-aa3fd296-42f8-4cb6-a320-064743133067 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:19:03.048503 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-aa3fd296-42f8-4cb6-a320-064743133067 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.266618 Jun 02 09:19:03.049104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 451/881] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:19:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:19:05.360759 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1084619258", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568ba997-047d-4381-9ac9-da024d18d18a"}], "security_groups": [{"name": "tempest-securitygroup--761237521"}], "key_name": "tempest-keypair-1703961789", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:19:05.369762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:05.370485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=30 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:05.515533 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] validate_networks() for [('568ba997-047d-4381-9ac9-da024d18d18a', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:19:05.914810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:19:05.915252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:19:05.915732 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:19:05.916143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:19:05.916937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:19:05.928708 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:05.929157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:05.930038 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:05.930531 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:05.951209 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:19:05.955707 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:19:05.969618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:19:05.973253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:19:06.084898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c3c8ca4e-de5a-428c-a586-ae179589b055 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728868 Jun 02 09:19:06.086850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 431/882] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:19:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:19:06.097012 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3ca31828-cf30-4fc6-b6cd-7df59a9f8d6d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:06.098291 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3ca31828-cf30-4fc6-b6cd-7df59a9f8d6d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:06.200368 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3ca31828-cf30-4fc6-b6cd-7df59a9f8d6d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:06.209311 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3ca31828-cf30-4fc6-b6cd-7df59a9f8d6d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1242 microversion: 2.1 time: 0.116172 Jun 02 09:19:06.221046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 452/883] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:06 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:07.228149 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:07.228772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:07.235611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:07.236062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:07.236833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:07.237274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:07.297284 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:07.304610 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-05f48148-47b7-4922-9651-559648b7f29d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1246 microversion: 2.1 time: 0.081328 Jun 02 09:19:07.305158 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 432/884] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:07 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:08.321180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:08.321819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:08.328293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:08.328743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:08.329513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:08.329952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:08.392721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:08.400173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5c259622-3400-4d2f-bd82-b61688a9cbb8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1246 microversion: 2.1 time: 0.082787 Jun 02 09:19:08.400742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 453/885] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:08 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:09.416706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:09.417325 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:09.424120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:09.424577 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:09.425356 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:09.425798 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:09.490681 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:09.498761 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-75d35f78-ce59-4ef1-b95b-14e3f7123fb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1294 microversion: 2.1 time: 0.085970 Jun 02 09:19:09.499339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 433/886] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:09 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:10.521658 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:10.522306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:10.529367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:10.529819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:10.530591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:10.531028 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:10.599341 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:10.606660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ba98f416-229f-452a-b4db-4595957b8299 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1300 microversion: 2.1 time: 0.088870 Jun 02 09:19:10.607228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 454/887] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:10 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:11.623779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:11.626253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:11.632753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:11.636549 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:11.637587 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:11.638200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:11.833678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:11.842030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-68a872c1-a104-4596-8c87-a792bb46dc31 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.222136 Jun 02 09:19:11.842589 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 434/888] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:11 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:11.984333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-f5c14ebf-5184-466c-84c3-371fc64b44a6 req-ee3a8864-9b64-4957-8307-dc08a289b389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b12fb97-d295-483c-81da-cf21e9b57720", "tag": "adc42d15-71f0-4f5e-b054-43401f570352"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:19:11.993601 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-f5c14ebf-5184-466c-84c3-371fc64b44a6 req-ee3a8864-9b64-4957-8307-dc08a289b389 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:11.993808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-f5c14ebf-5184-466c-84c3-371fc64b44a6 req-ee3a8864-9b64-4957-8307-dc08a289b389 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:12.009819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-f5c14ebf-5184-466c-84c3-371fc64b44a6 req-ee3a8864-9b64-4957-8307-dc08a289b389 service nova] Creating event network-changed:adc42d15-71f0-4f5e-b054-43401f570352 for instance 5b12fb97-d295-483c-81da-cf21e9b57720 on hv-cinder-82549 Jun 02 09:19:12.016070 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-f5c14ebf-5184-466c-84c3-371fc64b44a6 req-ee3a8864-9b64-4957-8307-dc08a289b389 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Jun 02 09:19:12.016673 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 455/889] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:19:12.859688 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:12.860295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:12.867580 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:12.868052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:12.868813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:12.869603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:13.009273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:13.016742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b64ee06a-44df-434a-ab6f-ebea05ec19db tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.160923 Jun 02 09:19:13.017296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 435/890] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:12 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:14.034981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:14.035627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:14.042236 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:14.042686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:14.043494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:14.043936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:14.172956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:14.180447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e8f944ed-9761-4f51-9acb-aaf1b6b3e5a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.150277 Jun 02 09:19:14.181010 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 456/891] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:14 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:15.197315 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:15.197930 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:15.204466 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:15.204920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:15.205690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:15.206130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:15.334879 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:15.342895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-464ae75b-a71f-4ffc-8715-2cf04f988440 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.149500 Jun 02 09:19:15.343480 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 436/892] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:15 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:16.360399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:16.360918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:16.363316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:16.368347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:16.368802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:16.369901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:16.370004 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:16.498637 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:16.506056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5314c26d-c075-4412-b33d-4ac7ca78ba49 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.149546 Jun 02 09:19:16.506651 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 457/893] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:16 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:17.524212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:17.524827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:17.526829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:17.527502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:17.532341 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:17.532829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:17.533590 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:17.534055 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:17.662969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:17.671663 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7998353a-92fb-4515-8761-abba888b8cdd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.151520 Jun 02 09:19:17.680700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 437/894] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:17 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:18.566962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-2b5fc782-a828-4d0b-b6e2-d8cfb2a62460 req-f6c3bcbe-a1c7-4831-9694-c74347cbd3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b12fb97-d295-483c-81da-cf21e9b57720", "name": "network-vif-plugged", "status": "completed", "tag": "adc42d15-71f0-4f5e-b054-43401f570352"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:19:18.575875 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2b5fc782-a828-4d0b-b6e2-d8cfb2a62460 req-f6c3bcbe-a1c7-4831-9694-c74347cbd3f0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:18.576310 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2b5fc782-a828-4d0b-b6e2-d8cfb2a62460 req-f6c3bcbe-a1c7-4831-9694-c74347cbd3f0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:18.586818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-2b5fc782-a828-4d0b-b6e2-d8cfb2a62460 req-f6c3bcbe-a1c7-4831-9694-c74347cbd3f0 service nova] Creating event network-vif-plugged:adc42d15-71f0-4f5e-b054-43401f570352 for instance 5b12fb97-d295-483c-81da-cf21e9b57720 on hv-cinder-82549 Jun 02 09:19:18.591765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-2b5fc782-a828-4d0b-b6e2-d8cfb2a62460 req-f6c3bcbe-a1c7-4831-9694-c74347cbd3f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028415 Jun 02 09:19:18.592359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 458/895] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:19:18.688754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:18.690294 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:18.698215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:18.698215 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:18.698561 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:18.698995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:19.146669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:19.155316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9845dc8c-1cbf-4d37-bc26-c5760413c22a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.470641 Jun 02 09:19:19.155877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 438/896] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:18 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:20.174515 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:20.175211 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:20.182443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:20.183034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:20.183868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:20.184308 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:20.323337 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:20.330773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-010c3fa5-2c4a-45ad-9579-33940bd7b6a1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1367 microversion: 2.1 time: 0.161526 Jun 02 09:19:20.331367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 459/897] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:20 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:21.347630 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:21.348242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:21.354673 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:21.355114 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:21.358307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:21.358307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:21.484730 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:19:21.492715 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8cb89052-ecb9-4395-afb7-7ce7e343c0d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1556 microversion: 2.1 time: 0.148984 Jun 02 09:19:21.493261 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 439/898] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:19:21 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:19:21.510096 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:21.510771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:21.517078 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:21.517516 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:21.518295 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:21.518732 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:21.594391 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7f72296d-75bb-40d9-a172-4f66ed7e5e21 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088912 Jun 02 09:19:21.594990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 460/899] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:19:21 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:19:22.561297 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-0508c22d-75c0-4ff2-88b4-d83b4e7e5f57 req-2edf14f3-195b-4688-9d36-b212dd9f601d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b12fb97-d295-483c-81da-cf21e9b57720", "tag": "adc42d15-71f0-4f5e-b054-43401f570352"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:19:22.569551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-0508c22d-75c0-4ff2-88b4-d83b4e7e5f57 req-2edf14f3-195b-4688-9d36-b212dd9f601d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:22.569992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-0508c22d-75c0-4ff2-88b4-d83b4e7e5f57 req-2edf14f3-195b-4688-9d36-b212dd9f601d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:22.583551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-0508c22d-75c0-4ff2-88b4-d83b4e7e5f57 req-2edf14f3-195b-4688-9d36-b212dd9f601d service nova] Creating event network-changed:adc42d15-71f0-4f5e-b054-43401f570352 for instance 5b12fb97-d295-483c-81da-cf21e9b57720 on hv-cinder-82549 Jun 02 09:19:22.589307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-0508c22d-75c0-4ff2-88b4-d83b4e7e5f57 req-2edf14f3-195b-4688-9d36-b212dd9f601d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031772 Jun 02 09:19:22.589971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 440/900] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:19:58.575030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:58.575811 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=38 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:19:58.579703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:19:58.580189 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:19:58.586031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:58.589764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:58.589764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:19:58.589764 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:19:58.610702 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1bf5a90d-904c-4c9f-b657-d34c0e61cdd9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/ips" status: 200 len: 149 microversion: 2.1 time: 0.037781 Jun 02 09:19:58.611330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 461/901] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:19:58 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:00.278116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:00.278865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=52 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:00.283011 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7d48059-ad45-4805-bd11-323d536e85bd"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:00.284173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:00.290129 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:00.292636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:00.292636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:00.292636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:00.951969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-f97fa1bc-3f97-4563-99e2-6d58b17c5a3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675098 Jun 02 09:20:00.952607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 441/902] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:20:00 2022] POST /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:09.490441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-eae0cb55-08bc-48f5-a7ac-1ff7a9cd9c38 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: .version_select at 0x7f96703fe9d0>, body: {"keypair": {"name": "tempest-keypair-1938636384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoyQzAvH2cWD0BOKyy6HYiQAw3sOz9etw+GgmmMtw3ffwOXtzDVvKlE/Oza8LdOiCYXrP3QoMLgqkK5whTx4zGEyn8UWqXH4g5yo5QTX/fHwqKT0nYAapOMATSbi8sWvw=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:09.505302 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-eae0cb55-08bc-48f5-a7ac-1ff7a9cd9c38 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:20:09.509366 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-eae0cb55-08bc-48f5-a7ac-1ff7a9cd9c38 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:20:09.560384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-eae0cb55-08bc-48f5-a7ac-1ff7a9cd9c38 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074356 Jun 02 09:20:09.560974 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 462/903] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:20:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:11.560985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:11.561744 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:11.566216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-508435009", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568ba997-047d-4381-9ac9-da024d18d18a"}], "security_groups": [{"name": "tempest-securitygroup--79431385"}], "key_name": "tempest-keypair-1938636384", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:11.692046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] validate_networks() for [('568ba997-047d-4381-9ac9-da024d18d18a', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:20:12.319624 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:20:12.326190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:20:12.326190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:20:12.326190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:20:12.326190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:20:12.330339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:12.330790 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:12.331623 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:12.332131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:12.350111 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:20:12.354168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:20:12.366524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:20:12.368997 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:20:12.492948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d945a5db-af42-4f48-9dde-ed02f3f69ec5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.933854 Jun 02 09:20:12.493586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 442/904] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:20:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:20:12.503894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-214e34a5-c649-442c-b3fe-2855e7f59a55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:12.504517 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-214e34a5-c649-442c-b3fe-2855e7f59a55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:12.556907 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-214e34a5-c649-442c-b3fe-2855e7f59a55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:12.564416 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-214e34a5-c649-442c-b3fe-2855e7f59a55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1241 microversion: 2.1 time: 0.064865 Jun 02 09:20:12.564968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 463/905] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:12 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:13.581664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-773ef1f4-28ab-4b06-9e03-f1664a6938bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:13.582296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-773ef1f4-28ab-4b06-9e03-f1664a6938bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:13.634513 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-773ef1f4-28ab-4b06-9e03-f1664a6938bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:13.641070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-773ef1f4-28ab-4b06-9e03-f1664a6938bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1241 microversion: 2.1 time: 0.063716 Jun 02 09:20:13.641618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 443/906] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:13 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:14.657628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-41b64448-618a-4c0e-a2b6-39da742c78e9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:14.658234 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-41b64448-618a-4c0e-a2b6-39da742c78e9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:14.710122 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-41b64448-618a-4c0e-a2b6-39da742c78e9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:14.716981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-41b64448-618a-4c0e-a2b6-39da742c78e9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1241 microversion: 2.1 time: 0.063236 Jun 02 09:20:14.717536 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 464/907] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:14 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:15.734401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c72e7241-cf00-4d5c-9c41-f30ccb176024 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:15.735037 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c72e7241-cf00-4d5c-9c41-f30ccb176024 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:15.788474 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c72e7241-cf00-4d5c-9c41-f30ccb176024 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:15.795526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c72e7241-cf00-4d5c-9c41-f30ccb176024 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1241 microversion: 2.1 time: 0.065449 Jun 02 09:20:15.796077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 444/908] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:15 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:16.813068 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:16.813617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:16.820648 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:16.821089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:16.821848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:16.822277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:16.880752 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:16.888916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-64cef6bd-a2be-45f0-b4b8-882aa3d3d849 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1245 microversion: 2.1 time: 0.080476 Jun 02 09:20:16.889462 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 465/909] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:16 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:20:17.906057 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:17.906665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:17.914188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:17.914632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:17.915431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:17.915866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:17.977482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:17.984886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d72f0b81-182d-4ef2-a1ac-440d01f67ef6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1293 microversion: 2.1 time: 0.083210 Jun 02 09:20:17.985438 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 445/910] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:17 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:19.002187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:19.002853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:19.009918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:19.011422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:19.011422 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:19.011703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:19.119453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:19.127362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6d9aa2c9-3805-4a89-94d7-de79015d9d34 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1299 microversion: 2.1 time: 0.129042 Jun 02 09:20:19.127969 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 466/911] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:18 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:20:20.145769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:20.146411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:20.153596 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:20.154047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:20.154811 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:20.155263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:20.351144 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:20.359158 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-70fe7bc0-d692-43d4-ad72-05141f7bc18f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.217305 Jun 02 09:20:20.359689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 446/912] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:20 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:20:20.435051 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-c0fd682f-a00b-4f29-9fcf-61a77091c849 req-bd776873-1505-4540-8372-475b34bd406b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412f6bfb-f93c-4b96-b72c-29577c450255", "tag": "0cb5098f-1573-491f-b75d-ee46b0535f79"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:20.445346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c0fd682f-a00b-4f29-9fcf-61a77091c849 req-bd776873-1505-4540-8372-475b34bd406b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:20.446108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c0fd682f-a00b-4f29-9fcf-61a77091c849 req-bd776873-1505-4540-8372-475b34bd406b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:20.457998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-c0fd682f-a00b-4f29-9fcf-61a77091c849 req-bd776873-1505-4540-8372-475b34bd406b service nova] Creating event network-changed:0cb5098f-1573-491f-b75d-ee46b0535f79 for instance 412f6bfb-f93c-4b96-b72c-29577c450255 on hv-cinder-82549 Jun 02 09:20:20.463403 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-c0fd682f-a00b-4f29-9fcf-61a77091c849 req-bd776873-1505-4540-8372-475b34bd406b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032049 Jun 02 09:20:20.464003 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 467/913] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:21.376348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:21.376957 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:21.383644 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:21.384089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:21.384845 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:21.385274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:21.513656 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:21.523018 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5be46dae-6fb8-44b3-9451-ffe128d5d64e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.150163 Jun 02 09:20:21.523607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 447/914] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:21 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:22.540999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:22.541612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:22.547797 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:22.548243 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:22.549000 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:22.549430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:22.675978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:22.683640 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-250b03af-62e3-45a0-91d7-36a55dc05c4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.147388 Jun 02 09:20:22.684703 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 468/915] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:22 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:23.701399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:23.709195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:23.709195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:23.709195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:23.709798 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:23.710575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:23.711016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:23.843184 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:23.850560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6c4e138c-08cd-452c-99b1-d79971825acf tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.153547 Jun 02 09:20:23.851120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 448/916] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:23 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:24.867578 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:24.868199 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:24.870219 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=8 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:24.877653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:24.877653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:24.877653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:24.877653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:25.008156 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:25.015920 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a10fd2fa-2500-4835-bfa6-1b08fce813f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.152492 Jun 02 09:20:25.016478 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 469/917] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:24 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:25.236028 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:25.236550 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:25.243431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:25.243777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:25.244542 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:25.244977 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:25.268032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lazy-loading 'flavor' on Instance uuid fca180fc-3453-47de-a315-d0d1630219de {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:20:25.472568 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-499ce765-dfff-4296-9912-5af62aa86e7a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "POST /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de/action" status: 202 len: 0 microversion: 2.1 time: 0.240337 Jun 02 09:20:25.473127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 449/918] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:20:25 2022] POST /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:20:25.481939 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:25.482793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:25.488567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:25.488951 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:25.489715 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:25.490146 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:25.624679 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:25.632421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5f8f222c-096e-4963-b924-4b2c704941c7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.155023 Jun 02 09:20:25.632992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 470/919] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:25 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:26.030456 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=10 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:26.034743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:26.035481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:26.041600 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:26.042167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:26.042989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:26.043940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:26.170842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:26.178233 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3cc3b086-2c1f-4c0f-88a9-81e2895e4877 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.148816 Jun 02 09:20:26.178827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 450/920] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:26 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:20:26.649913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:26.650560 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:26.656916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:26.657362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:26.658137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:26.658574 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:26.791586 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:26.799763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5001994c-a8ce-46f2-88db-686512b718c1 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.153657 Jun 02 09:20:26.800346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 471/921] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:26 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:26.838702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-bf46299f-f659-4436-88da-0b901168e0de req-9ea64d65-71f6-4cd4-8cec-6cd470f0ad67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f6bfb-f93c-4b96-b72c-29577c450255", "name": "network-vif-plugged", "status": "completed", "tag": "0cb5098f-1573-491f-b75d-ee46b0535f79"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:26.847709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-bf46299f-f659-4436-88da-0b901168e0de req-9ea64d65-71f6-4cd4-8cec-6cd470f0ad67 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:26.848154 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-bf46299f-f659-4436-88da-0b901168e0de req-9ea64d65-71f6-4cd4-8cec-6cd470f0ad67 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:26.859835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-bf46299f-f659-4436-88da-0b901168e0de req-9ea64d65-71f6-4cd4-8cec-6cd470f0ad67 service nova] Creating event network-vif-plugged:0cb5098f-1573-491f-b75d-ee46b0535f79 for instance 412f6bfb-f93c-4b96-b72c-29577c450255 on hv-cinder-82549 Jun 02 09:20:26.864616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-bf46299f-f659-4436-88da-0b901168e0de req-9ea64d65-71f6-4cd4-8cec-6cd470f0ad67 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029705 Jun 02 09:20:26.865238 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 451/922] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:27.195731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:27.196263 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:27.202612 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:27.203064 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:27.203880 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:27.204322 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:27.354241 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:27.362242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-64ac811d-eefa-42df-8bbf-88c1a6f66b68 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.170512 Jun 02 09:20:27.362799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 472/923] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:27 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:27.817742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:27.818446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:27.824769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:27.825214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:27.825976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:27.826412 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:27.957694 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:27.965866 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6e1e081b-bc8a-4b09-a8a9-df38d410146b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.151725 Jun 02 09:20:27.966432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 452/924] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:27 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:28.378141 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:28.378754 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:28.385421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:28.385857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:28.386614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:28.387554 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:28.511720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:28.519627 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ae104ac6-b421-4da5-b9a2-17d00f446fca tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1365 microversion: 2.1 time: 0.145283 Jun 02 09:20:28.520195 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 473/925] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:28 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:28.983296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:28.983941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:28.990622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:28.991075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:28.991899 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:28.992339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:29.128380 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:29.136431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5d29e775-8504-41c0-bbf4-a580003cafb0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.157554 Jun 02 09:20:29.137036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 453/926] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:28 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:29.537527 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:29.538103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:29.545125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:29.545571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:29.546340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:29.546773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:29.672357 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:29.679748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-328fa7bd-9784-490e-b90d-b83b95aa0790 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1555 microversion: 2.1 time: 0.146160 Jun 02 09:20:29.680316 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 474/927] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:29 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:29.695702 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:29.696195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:29.702606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:29.703047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:29.703852 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:29.704279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:29.778985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-98ebbf48-3a74-4008-9c5d-a43909d0b3a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087018 Jun 02 09:20:29.779622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 454/928] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:20:29 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:30.153670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:30.154309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:30.160362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:30.163507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:30.163507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:30.163507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:30.337073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:30.344729 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-937e816a-549e-4b3a-9d9a-c6f109ead64f tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.195041 Jun 02 09:20:30.345389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 475/929] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:30 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:31.025667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-2fc86082-0ee2-44be-89ac-99f9cbbde66c req-e1f789f2-9c18-4b16-a43f-f3bd7cd037db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "412f6bfb-f93c-4b96-b72c-29577c450255", "tag": "0cb5098f-1573-491f-b75d-ee46b0535f79"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:31.034521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-2fc86082-0ee2-44be-89ac-99f9cbbde66c req-e1f789f2-9c18-4b16-a43f-f3bd7cd037db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:31.034984 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-2fc86082-0ee2-44be-89ac-99f9cbbde66c req-e1f789f2-9c18-4b16-a43f-f3bd7cd037db service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:31.047119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-2fc86082-0ee2-44be-89ac-99f9cbbde66c req-e1f789f2-9c18-4b16-a43f-f3bd7cd037db service nova] Creating event network-changed:0cb5098f-1573-491f-b75d-ee46b0535f79 for instance 412f6bfb-f93c-4b96-b72c-29577c450255 on hv-cinder-82549 Jun 02 09:20:31.053106 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-2fc86082-0ee2-44be-89ac-99f9cbbde66c req-e1f789f2-9c18-4b16-a43f-f3bd7cd037db service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031903 Jun 02 09:20:31.053814 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 455/930] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:31.361850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:31.362476 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:31.371535 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:31.371995 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:31.372787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:31.373227 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:31.623443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:31.631125 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-cddf6e84-0db0-4542-b5c0-bb610ff1dc2a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.273147 Jun 02 09:20:31.632117 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 476/931] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:31 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:32.649369 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:32.650075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:32.656831 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:32.657281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:32.658045 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:32.658482 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:32.793376 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:32.800930 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7d60d83c-1910-4ae6-b0b9-4eb1acd0faf6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.156221 Jun 02 09:20:32.801485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 456/932] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:32 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:33.817740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:33.818349 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:33.824647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:33.825090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:33.825855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:33.826283 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:33.956222 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:33.963871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0aad9178-f44e-42fb-9fc8-2a5b5f35477c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.149940 Jun 02 09:20:33.964453 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 477/933] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:33 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:34.980748 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:34.981366 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:34.987934 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:34.988385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:34.989150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:34.989664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:35.122322 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:35.129980 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c459284a-706e-44f1-95b5-49212ff174fa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.153120 Jun 02 09:20:35.130544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 457/934] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:34 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:36.147527 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:36.148149 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:36.155121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:36.155591 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:36.156355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:36.156785 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:36.369585 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:36.377128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b83e77f6-e6f1-4b3d-acd3-e620312ffea2 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.233772 Jun 02 09:20:36.377701 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 478/935] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:36 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:37.393857 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:37.394471 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:37.401105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:37.401557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:37.402931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:37.403407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:37.537387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:37.544848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-25fe33c7-3bf9-4303-8226-c9307aeeb10d tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.154808 Jun 02 09:20:37.545405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 458/936] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:37 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:38.561979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:38.562593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:38.569284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:38.569731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:38.570532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:38.570962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:38.702320 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:38.709923 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-72cdb6f6-1692-4671-91c5-fb257af8ee22 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.151793 Jun 02 09:20:38.710493 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 479/937] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:38 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:39.727537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:39.728153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:39.734700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:39.735155 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:39.735965 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:39.736405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:39.862630 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:39.870085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2cfaf004-ad16-4b8b-a61d-69e66200c604 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1510 microversion: 2.1 time: 0.146507 Jun 02 09:20:39.870648 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 459/938] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:39 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:39.887820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:39.888385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:39.890722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:39.895412 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:39.895857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:39.896617 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:39.897104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:39.900674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=91 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:40.101760 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [669cf25d-2634-4286-b36b-52ca5b9435e5] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 09:20:41.108628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [669cf25d-2634-4286-b36b-52ca5b9435e5] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40022. Jun 02 09:20:41.111822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-19793103-a30d-483e-8319-1b70f4393750 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "POST /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de/action" status: 202 len: 0 microversion: 2.1 time: 1.229070 Jun 02 09:20:41.112615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 480/939] 10.222.0.18 () {60 vars in 1277 bytes} [Thu Jun 2 09:20:39 2022] POST /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de/action => generated 0 bytes in 1230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:20:41.120338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:41.120945 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:41.127105 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:41.127587 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:41.128348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:41.128777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:41.294139 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:41.297668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:41.302019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b3393e28-3b38-4bc4-a6d9-7cc4dfff6e69 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1518 microversion: 2.1 time: 0.185432 Jun 02 09:20:41.302593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 460/940] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:41 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:42.319904 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:42.320515 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:42.326691 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:42.327133 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:42.327922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:42.328354 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:42.462852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:42.470993 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4830bcaf-4e93-4540-9ce8-452a627207c3 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1520 microversion: 2.1 time: 0.155641 Jun 02 09:20:42.471594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 481/941] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:42 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:42.823217 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-a4191de3-23e5-409e-8db9-73eea29bcf74 req-7277d689-0f0d-49a7-9cb7-43f80d1f69c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "name": "network-vif-unplugged", "status": "completed", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:42.828003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:20:42.833382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-a4191de3-23e5-409e-8db9-73eea29bcf74 req-7277d689-0f0d-49a7-9cb7-43f80d1f69c4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:42.833821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-a4191de3-23e5-409e-8db9-73eea29bcf74 req-7277d689-0f0d-49a7-9cb7-43f80d1f69c4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:42.844614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.compute.server_external_events [req-a4191de3-23e5-409e-8db9-73eea29bcf74 req-7277d689-0f0d-49a7-9cb7-43f80d1f69c4 service nova] Unable to find a host for instance fca180fc-3453-47de-a315-d0d1630219de. Dropping event network-vif-unplugged {{(pid=118037) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 02 09:20:42.849381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-a4191de3-23e5-409e-8db9-73eea29bcf74 req-7277d689-0f0d-49a7-9cb7-43f80d1f69c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026439 Jun 02 09:20:42.849381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 461/942] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 02 09:20:43.491834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:43.492423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:43.501110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:43.501914 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:43.503052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:43.503519 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:43.634110 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:43.641744 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1c52f16b-7286-4e0e-912c-b7e48f4593ea tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.153858 Jun 02 09:20:43.642351 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 482/943] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:43 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:44.658372 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:44.658982 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:44.667119 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:44.668318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:44.685863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:44.685863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:44.805056 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:44.813406 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-75af78af-f683-48fe-a4bc-dec705bca91b tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.158999 Jun 02 09:20:44.814081 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 462/944] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:44 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:45.830546 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:45.831130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:45.837686 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:45.838135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:45.838902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:45.839364 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:45.968665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:45.976103 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bd8a05ad-7528-42ef-810d-cf59c0c2f644 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.149478 Jun 02 09:20:45.976660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 483/945] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:45 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:46.992826 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:46.993473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:47.000410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:47.000865 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:47.001635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:47.002071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:47.132419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:47.140125 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8048be61-d043-4029-a229-615843b3803e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.151127 Jun 02 09:20:47.140687 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 463/946] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:46 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:48.156982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:48.157587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:48.164090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:48.164531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:48.165284 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:48.165715 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:48.291821 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:48.299138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-10316362-9c03-4dd8-959d-718d54e1b3f9 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.146021 Jun 02 09:20:48.299731 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 484/947] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:48 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:49.316321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:49.316884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:49.323383 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:49.324320 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:49.325089 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:49.325523 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:49.453071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:49.460572 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ff4b12d7-7888-4f7c-a16e-bd41e80db530 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.148188 Jun 02 09:20:49.461136 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 464/948] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:49 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:50.477778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:50.478384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:50.485462 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:50.485901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:50.486662 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:50.487088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:50.618832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:50.626778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6b33b511-2508-48cd-807d-b51ee5b926df tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.152762 Jun 02 09:20:50.627380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 485/949] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:50 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:51.645569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:51.646210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:51.652727 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:51.653176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:51.653947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:51.654388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:51.782194 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:51.789718 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d60fdea2-28bf-46b2-ad2a-ad978c6b47a7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.147996 Jun 02 09:20:51.790268 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 465/950] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:51 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:52.807155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:52.808329 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:52.814775 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:52.815242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:52.816035 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:52.816472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:52.952442 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:52.960324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-297391a2-a07e-4301-880a-683383c821d7 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.157078 Jun 02 09:20:52.960932 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 486/951] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:52 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:20:53.977770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:53.978308 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:53.984908 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:53.985349 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:53.986103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:53.986534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:54.114511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:54.122538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ec570560-f660-4383-bd6a-be335af16eb6 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.148685 Jun 02 09:20:54.123103 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 466/952] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:53 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:54.889874 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-b71eeeaf-a808-40c0-ac6f-ac4688cb1e67 req-52799502-133b-4c36-92ab-ea804040ac02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "name": "network-vif-plugged", "status": "completed", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:20:54.898085 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-b71eeeaf-a808-40c0-ac6f-ac4688cb1e67 req-52799502-133b-4c36-92ab-ea804040ac02 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:54.898533 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-b71eeeaf-a808-40c0-ac6f-ac4688cb1e67 req-52799502-133b-4c36-92ab-ea804040ac02 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:54.909363 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-b71eeeaf-a808-40c0-ac6f-ac4688cb1e67 req-52799502-133b-4c36-92ab-ea804040ac02 service nova] Creating event network-vif-plugged:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:20:54.914427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-b71eeeaf-a808-40c0-ac6f-ac4688cb1e67 req-52799502-133b-4c36-92ab-ea804040ac02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029005 Jun 02 09:20:54.915081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 487/953] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:20:55.140686 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:55.141287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:55.147944 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:55.148931 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:55.149696 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:55.150127 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:55.332973 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:55.340557 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-89aa548d-4aa4-4220-8406-63be29777ff0 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.204494 Jun 02 09:20:55.341131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 467/954] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:55 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:56.358499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:56.359190 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:56.365396 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:56.365855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:56.366597 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:56.367027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:56.497853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:56.505357 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-417dc895-b8eb-401c-b7b4-6f0a767c096a tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1576 microversion: 2.1 time: 0.151539 Jun 02 09:20:56.505936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 488/955] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:56 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:20:57.523222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:20:57.523883 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:20:57.531066 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:57.531548 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:57.532311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:20:57.532753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:20:57.666851 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:20:57.674465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c7a02c1b-8622-447e-bfa9-693b1a4411e8 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1563 microversion: 2.1 time: 0.155090 Jun 02 09:20:57.675026 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 468/956] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:20:57 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:06.950658 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:06.951174 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:06.953737 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=19 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:06.954421 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:06.959199 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:06.959669 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:06.960431 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:06.960868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:06.983062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-db425adb-42cd-4d4e-9196-d680850f8099 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/ips" status: 200 len: 149 microversion: 2.1 time: 0.036942 Jun 02 09:21:06.983670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 489/957] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:21:06 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:06.994019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7d48059-ad45-4805-bd11-323d536e85bd"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:06.998289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:07.002200 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.002647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.003512 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.003951 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.244551 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/os-volume_attachments HTTP/1.1 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 74 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:21:07.246987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volumeAttachment": {"volumeId": "f7d48059-ad45-4805-bd11-323d536e85bd"}} Jun 02 09:21:07.248752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'server_id': '412f6bfb-f93c-4b96-b72c-29577c450255', 'body': {'volumeAttachment': {'volumeId': 'f7d48059-ad45-4805-bd11-323d536e85bd'}}} Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:21:07.249668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:07.251032 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 400 to user: Invalid volume: volume f7d48059-ad45-4805-bd11-323d536e85bd is already attached to instances: 5b12fb97-d295-483c-81da-cf21e9b57720 {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-262dfec5-8d23-400d-9205-aaa53b7c0ed9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.258472 Jun 02 09:21:07.252346 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 469/958] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:21:06 2022] POST /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255/os-volume_attachments => generated 174 bytes in 260 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:21:07.257509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:07.258283 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:07.265177 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.265646 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.266399 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.266840 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.290851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:21:07.563575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-585575bb-c43e-4a20-8b13-d24a190a09bc tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 204 len: 0 microversion: 2.1 time: 0.309976 Jun 02 09:21:07.564165 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 490/959] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:21:07 2022] DELETE /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:21:07.572242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:07.572855 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:07.580312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.580836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.581611 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:07.582048 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:07.708121 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:07.716118 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-72a0a5cd-48db-4936-aa5c-a13c55c485d9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1679 microversion: 2.1 time: 0.147658 Jun 02 09:21:07.716678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 470/960] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:07 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:08.733968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:08.734677 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:08.741283 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:08.741734 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:08.742509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:08.742947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:08.974106 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:08.982176 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d2920183-e2e4-4fdb-aebb-4c255cf03e2d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1679 microversion: 2.1 time: 0.253095 Jun 02 09:21:08.985860 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 491/961] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:08 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:09.998912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:09.999762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:10.006502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:10.006995 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:10.008174 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:10.008617 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:10.106207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:10.113700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e5c97060-2e18-4ad4-b1e0-4e0a7cdbe5b7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1613 microversion: 2.1 time: 0.118607 Jun 02 09:21:10.114261 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 471/962] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:09 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:21:10.220702 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-792a3724-2aab-46e4-af9b-0a958d98ee3c req-8b22a6bf-560a-4e93-9ead-1b74f1934eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "412f6bfb-f93c-4b96-b72c-29577c450255", "name": "network-vif-deleted", "tag": "0cb5098f-1573-491f-b75d-ee46b0535f79"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:10.229087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-792a3724-2aab-46e4-af9b-0a958d98ee3c req-8b22a6bf-560a-4e93-9ead-1b74f1934eeb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:10.229525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-792a3724-2aab-46e4-af9b-0a958d98ee3c req-8b22a6bf-560a-4e93-9ead-1b74f1934eeb service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:10.240255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-792a3724-2aab-46e4-af9b-0a958d98ee3c req-8b22a6bf-560a-4e93-9ead-1b74f1934eeb service nova] Creating event network-vif-deleted:0cb5098f-1573-491f-b75d-ee46b0535f79 for instance 412f6bfb-f93c-4b96-b72c-29577c450255 on hv-cinder-82549 Jun 02 09:21:10.245209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-792a3724-2aab-46e4-af9b-0a958d98ee3c req-8b22a6bf-560a-4e93-9ead-1b74f1934eeb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028264 Jun 02 09:21:10.245992 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 492/963] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:11.131070 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:11.131772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:11.138449 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:11.140073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:11.140073 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:11.140274 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:11.171009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:11.171487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:11.171937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'fault' on Instance uuid 412f6bfb-f93c-4b96-b72c-29577c450255 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:21:11.213344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:11.220921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1eaa8a39-ddb6-4f2f-bc62-761f608aba9e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 200 len: 1331 microversion: 2.1 time: 0.093678 Jun 02 09:21:11.221481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 472/964] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:11 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:12.239016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:12.239783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:12.245946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:12.246390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:12.247715 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:12.248145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:12.261309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 HTTP/1.1 Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:21:12.263708 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:21:12.265250 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '412f6bfb-f93c-4b96-b72c-29577c450255'} Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:21:12.266121 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:21:12.267447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:12.268590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:21:12.268590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a3023d97-7879-4a52-ac21-8bc7807b4a84 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 404 len: 111 microversion: 2.1 time: 0.030938 Jun 02 09:21:12.268590 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 493/965] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:12 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:21:12.274098 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8073cdc9-d316-4016-a1a0-8a3eedeaeb7d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '.version_select at 0x7f96703c6c10>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:12.277448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8073cdc9-d316-4016-a1a0-8a3eedeaeb7d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [5c05772c-8ee9-4af8-a247-96994ed75a0e] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 09:21:13.284718 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [None req-8073cdc9-d316-4016-a1a0-8a3eedeaeb7d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [5c05772c-8ee9-4af8-a247-96994ed75a0e] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 40100. Jun 02 09:21:13.346985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8073cdc9-d316-4016-a1a0-8a3eedeaeb7d tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938636384" status: 202 len: 0 microversion: 2.1 time: 1.076590 Jun 02 09:21:13.347606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 473/966] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 2 09:21:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938636384 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:21:14.108913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:14.109402 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:14.115848 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:14.116299 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:14.117065 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:14.117496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:14.196810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'services' on Instance uuid 5b12fb97-d295-483c-81da-cf21e9b57720 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:21:14.414091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a398a630-082a-4346-a2da-2d5fe9e8e593 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments/f7d48059-ad45-4805-bd11-323d536e85bd" status: 202 len: 0 microversion: 2.1 time: 0.309533 Jun 02 09:21:14.414681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 494/967] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:21:14 2022] DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments/f7d48059-ad45-4805-bd11-323d536e85bd => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:21:14.424287 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:14.425214 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:14.432941 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:14.433384 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:14.434150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:14.434581 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:14.462709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2dc0c3fc-b2fe-47d2-b691-99fbb621d5f4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 Jun 02 09:21:14.463270 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 474/968] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:21:14 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:15.475798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:15.476948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:15.484296 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:15.484742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:15.485509 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:15.485941 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:15.515970 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-880deed9-e3b0-430c-ad81-1379c8aa9f96 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Jun 02 09:21:15.522027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 495/969] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:21:15 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:16.527484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:16.528404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:16.530260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:16.534924 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.535405 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:16.536160 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.536619 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:16.540147 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=77 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:16.564386 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-183f9dfa-f487-44b5-86af-c0806ff5d503 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041028 Jun 02 09:21:16.565023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 475/970] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:21:16 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:21:16.620762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:16.621260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:16.628135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.628576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:16.629335 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.629765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:16.654705 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:21:16.906187 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-660356fc-d4a7-400c-a010-fa45f407d243 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 204 len: 0 microversion: 2.1 time: 0.288870 Jun 02 09:21:16.906788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 496/971] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:21:16 2022] DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:21:16.915145 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:16.915785 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:16.923426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.923854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:16.924618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:16.925051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:17.051868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:17.060161 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2eaa986a-8152-4003-bb46-90d3cc2ac7ec tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1681 microversion: 2.1 time: 0.149195 Jun 02 09:21:17.060714 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 476/972] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:16 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:18.078228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:18.078917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:18.085390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:18.085832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:18.086587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:18.087015 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:18.215796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:18.223458 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d2021172-84c0-4262-b0b2-c6d032bfa131 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1681 microversion: 2.1 time: 0.149909 Jun 02 09:21:18.224032 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 497/973] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:18 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:19.240029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:19.240979 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:19.247556 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:19.248000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:19.248763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:19.249197 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:19.449156 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:19.457310 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a28bd29f-84f1-414e-8cb2-f7dc66589d4c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1681 microversion: 2.1 time: 0.221032 Jun 02 09:21:19.457874 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 477/974] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:19 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:19.835696 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-411a7f95-57b4-4f52-ba53-a4958a0ba091 req-90b10d49-2aab-4f2b-a491-9714307ed22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b12fb97-d295-483c-81da-cf21e9b57720", "name": "network-vif-deleted", "tag": "adc42d15-71f0-4f5e-b054-43401f570352"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:19.844838 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-411a7f95-57b4-4f52-ba53-a4958a0ba091 req-90b10d49-2aab-4f2b-a491-9714307ed22d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:19.845348 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-411a7f95-57b4-4f52-ba53-a4958a0ba091 req-90b10d49-2aab-4f2b-a491-9714307ed22d service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:19.858586 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-411a7f95-57b4-4f52-ba53-a4958a0ba091 req-90b10d49-2aab-4f2b-a491-9714307ed22d service nova] Creating event network-vif-deleted:adc42d15-71f0-4f5e-b054-43401f570352 for instance 5b12fb97-d295-483c-81da-cf21e9b57720 on hv-cinder-82549 Jun 02 09:21:19.864373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-411a7f95-57b4-4f52-ba53-a4958a0ba091 req-90b10d49-2aab-4f2b-a491-9714307ed22d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Jun 02 09:21:19.865184 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 498/975] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:20.475099 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:20.475775 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:20.482987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:20.483535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:20.484367 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:20.484907 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:20.515627 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:20.516071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:20.516520 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'fault' on Instance uuid 5b12fb97-d295-483c-81da-cf21e9b57720 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:21:20.826228 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:20.833625 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-20a27b34-39d5-4088-8dee-3f97ebbe48ba tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 200 len: 1332 microversion: 2.1 time: 0.362177 Jun 02 09:21:20.834211 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 478/976] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:20 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 1332 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:21.859029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:21.859832 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:21.868347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:21.868818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:21.869586 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:21.870016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:21.883632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 HTTP/1.1 Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:21:21.885292 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:21:21.886899 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '5b12fb97-d295-483c-81da-cf21e9b57720'} Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:21:21.887878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:21:21.889371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:21:21.890802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:21:21.890802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-08571f37-7321-4696-bbf6-1988d497ef78 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 404 len: 111 microversion: 2.1 time: 0.038190 Jun 02 09:21:21.890802 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 499/977] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:21 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:21:21.895511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-de300ab4-5924-4bd2-abf8-266ff1fc6246 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '.version_select at 0x7f9670279040>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:21.958938 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-de300ab4-5924-4bd2-abf8-266ff1fc6246 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703961789" status: 202 len: 0 microversion: 2.1 time: 0.067091 Jun 02 09:21:21.959553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 479/978] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 2 09:21:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703961789 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:21:22.690858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1124bc6a-5215-4b16-99a4-ed20b1daaef9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: .version_select at 0x7f9670753430>, body: {"keypair": {"name": "tempest-keypair-2061027554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLguoER5K7BrDj9y+psV9+NOrRCxTxQdWtfJGplFznr4Cw899QhWm3sxlxBQoDAcYS2yhiTqmjjKKUfkty8J1ecq7x9cUc2EcUppydNPk5GUs8mvWxmHRCAm2xUA8lDagw=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:22.705428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-1124bc6a-5215-4b16-99a4-ed20b1daaef9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:21:22.709494 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-1124bc6a-5215-4b16-99a4-ed20b1daaef9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:21:22.770060 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1124bc6a-5215-4b16-99a4-ed20b1daaef9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083067 Jun 02 09:21:22.770647 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 500/979] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:21:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:24.771752 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-881114081", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568ba997-047d-4381-9ac9-da024d18d18a"}], "security_groups": [{"name": "tempest-securitygroup--14697640"}], "key_name": "tempest-keypair-2061027554", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:24.871824 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] validate_networks() for [('568ba997-047d-4381-9ac9-da024d18d18a', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:21:25.237840 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:21:25.238265 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:21:25.238769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:21:25.239182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:21:25.240234 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:21:25.249147 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:25.249599 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:25.250409 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:25.250848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:25.268286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:21:25.272327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:21:25.283911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:21:25.286191 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:21:25.422246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9dd5976a-b962-4c7f-b6b3-fc6453bd46ed tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.655114 Jun 02 09:21:25.422816 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 480/980] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:21:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:21:25.432659 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9624c2d4-cf9e-48cb-adbe-88c8bc53c156 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:25.433274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9624c2d4-cf9e-48cb-adbe-88c8bc53c156 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:25.488203 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-9624c2d4-cf9e-48cb-adbe-88c8bc53c156 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:25.495697 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9624c2d4-cf9e-48cb-adbe-88c8bc53c156 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1241 microversion: 2.1 time: 0.066822 Jun 02 09:21:25.496885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 501/981] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:25 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:26.513771 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:26.514425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:26.520860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:26.521311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:26.522083 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:26.522521 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:26.587779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:26.595822 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b502caec-6404-4e6a-a3a5-97903e0942e4 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1237 microversion: 2.1 time: 0.086398 Jun 02 09:21:26.596382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 481/982] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:26 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:21:27.617168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:27.617774 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:27.624935 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:27.625376 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:27.626136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:27.626567 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:27.697247 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:27.704844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3b6e0253-c92d-428a-893b-d6f28c7c144b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1311 microversion: 2.1 time: 0.091624 Jun 02 09:21:27.705408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 502/983] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:27 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:28.721334 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:28.721937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:28.728440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:28.728888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:28.729652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:28.730086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:28.955888 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:28.973122 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6aab7820-bcdc-423d-acb9-8258fc7c377b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.246047 Jun 02 09:21:28.974116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 482/984] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:28 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:29.148160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-de446979-6f24-48c5-8dc6-4dfd4730ccb8 req-d08d3732-8bc5-4e97-8fa3-1e089d7fabc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27392eff-38f5-494d-abb4-caf3926d2ca5", "tag": "c142dc1f-76a9-45bb-a29a-c013226439d1"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:29.159321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-de446979-6f24-48c5-8dc6-4dfd4730ccb8 req-d08d3732-8bc5-4e97-8fa3-1e089d7fabc4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:29.159765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-de446979-6f24-48c5-8dc6-4dfd4730ccb8 req-d08d3732-8bc5-4e97-8fa3-1e089d7fabc4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:29.172140 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-de446979-6f24-48c5-8dc6-4dfd4730ccb8 req-d08d3732-8bc5-4e97-8fa3-1e089d7fabc4 service nova] Creating event network-changed:c142dc1f-76a9-45bb-a29a-c013226439d1 for instance 27392eff-38f5-494d-abb4-caf3926d2ca5 on hv-cinder-82549 Jun 02 09:21:29.176968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-de446979-6f24-48c5-8dc6-4dfd4730ccb8 req-d08d3732-8bc5-4e97-8fa3-1e089d7fabc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032546 Jun 02 09:21:29.177596 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 503/985] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:29.991075 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:29.991841 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:29.999554 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:30.000000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:30.000754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:30.001183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:30.129706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:30.138199 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-769af98c-beb2-407a-9150-7ca20deff716 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.151089 Jun 02 09:21:30.138762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 483/986] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:29 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:31.156603 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:31.157309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:31.163534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:31.163990 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:31.164759 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:31.165200 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:31.291081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:31.298444 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e18902d3-4b0f-4b92-94c0-74221608ce14 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.147155 Jun 02 09:21:31.299002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 504/987] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:31 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:32.315800 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:32.316448 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:32.323018 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:32.323501 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:32.324912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:32.325342 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:32.455910 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:32.463312 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e5fb488c-91a8-4017-bf8a-4cb99673f63f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.151443 Jun 02 09:21:32.463876 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 484/988] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:32 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:33.481104 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:33.481645 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:33.488370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:33.488822 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:33.489603 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:33.490044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:33.618359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:33.625808 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f40530ef-9a0d-4335-b4c2-19ed0e1172b3 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.149234 Jun 02 09:21:33.626369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 505/989] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:33 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:21:34.642117 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:34.642721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:34.649249 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:34.649700 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:34.650459 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:34.650886 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:34.784556 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:34.791869 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bd2a7189-0518-4b4d-afbb-3a3bee800e1b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.153598 Jun 02 09:21:34.792425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 485/990] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:34 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:35.145505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-5a3e1ae2-7752-4474-8f39-f628560aa04b req-c1a18277-2ac6-45f4-9d63-745372e3125e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27392eff-38f5-494d-abb4-caf3926d2ca5", "name": "network-vif-plugged", "status": "completed", "tag": "c142dc1f-76a9-45bb-a29a-c013226439d1"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:35.154568 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5a3e1ae2-7752-4474-8f39-f628560aa04b req-c1a18277-2ac6-45f4-9d63-745372e3125e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:35.155053 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-5a3e1ae2-7752-4474-8f39-f628560aa04b req-c1a18277-2ac6-45f4-9d63-745372e3125e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:35.167825 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-5a3e1ae2-7752-4474-8f39-f628560aa04b req-c1a18277-2ac6-45f4-9d63-745372e3125e service nova] Creating event network-vif-plugged:c142dc1f-76a9-45bb-a29a-c013226439d1 for instance 27392eff-38f5-494d-abb4-caf3926d2ca5 on hv-cinder-82549 Jun 02 09:21:35.172900 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-5a3e1ae2-7752-4474-8f39-f628560aa04b req-c1a18277-2ac6-45f4-9d63-745372e3125e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Jun 02 09:21:35.173615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 506/991] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:35.809915 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:35.810437 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:35.812282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:35.812936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:35.818150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:35.818592 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:35.819420 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:35.819854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:35.959850 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:35.967787 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7218fb42-8ef0-4adf-973d-7ca5992a1f3b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1365 microversion: 2.1 time: 0.162369 Jun 02 09:21:35.972269 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 486/992] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:35 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:36.985099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:36.985798 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:36.987748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:36.993186 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:36.993642 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:36.994400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:36.994834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:37.127886 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:21:37.131293 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:37.135872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c69d81ea-5810-44e2-aeda-99a5c3baeb51 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1554 microversion: 2.1 time: 0.155028 Jun 02 09:21:37.136434 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 507/993] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:21:36 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:21:37.152296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:21:37.154614 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:21:37.159512 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:37.159962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:37.160733 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:37.161175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:37.240603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-53f2f914-86c8-44e7-99de-d96c4d4ca67f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088902 Jun 02 09:21:37.240603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 487/994] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:21:37 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:21:38.510321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-079b0495-b01a-4981-aeec-bf7f86619041 req-0551970f-f99c-4a3e-9572-c264525cc34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27392eff-38f5-494d-abb4-caf3926d2ca5", "tag": "c142dc1f-76a9-45bb-a29a-c013226439d1"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:21:38.514290 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:21:38.519836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-079b0495-b01a-4981-aeec-bf7f86619041 req-0551970f-f99c-4a3e-9572-c264525cc34a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:21:38.520317 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-079b0495-b01a-4981-aeec-bf7f86619041 req-0551970f-f99c-4a3e-9572-c264525cc34a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:21:38.531225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-079b0495-b01a-4981-aeec-bf7f86619041 req-0551970f-f99c-4a3e-9572-c264525cc34a service nova] Creating event network-changed:c142dc1f-76a9-45bb-a29a-c013226439d1 for instance 27392eff-38f5-494d-abb4-caf3926d2ca5 on hv-cinder-82549 Jun 02 09:21:38.536259 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-079b0495-b01a-4981-aeec-bf7f86619041 req-0551970f-f99c-4a3e-9572-c264525cc34a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087509 Jun 02 09:21:38.537024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 508/995] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:14.545949 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:14.546731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=67 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:14.550603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:14.551093 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:14.556971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:14.575124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:14.575124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:14.575124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:14.581348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-deee69a0-84d5-487b-bd5d-862ae87990fb tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036919 Jun 02 09:22:14.581895 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 488/996] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:22:14 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:16.087824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca573fc-be58-452e-8029-a53a1dd66026"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:16.088971 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:16.092204 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:16.097408 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:16.097855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:16.098625 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:16.099058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:16.908991 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-9ed16d5e-00d7-4ff3-9d7d-3e7a11b537ee tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825236 Jun 02 09:22:16.909788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 509/997] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:22:16 2022] POST /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:17.143849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-a173b11f-d04e-449e-9af3-36e47572f8de req-8369e67f-3c43-487f-8d44-00c7303b2004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:17.148296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:17.148736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:17.157222 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:17.157678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:17.158150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-a173b11f-d04e-449e-9af3-36e47572f8de req-8369e67f-3c43-487f-8d44-00c7303b2004 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:17.158455 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:17.158630 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-a173b11f-d04e-449e-9af3-36e47572f8de req-8369e67f-3c43-487f-8d44-00c7303b2004 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:17.158892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:17.179634 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-a173b11f-d04e-449e-9af3-36e47572f8de req-8369e67f-3c43-487f-8d44-00c7303b2004 service nova] Creating event network-changed:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:22:17.186138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-a173b11f-d04e-449e-9af3-36e47572f8de req-8369e67f-3c43-487f-8d44-00c7303b2004 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049357 Jun 02 09:22:17.186929 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 510/998] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:17.198745 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:22:17.447659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-592796a0-b411-45e6-b6e2-0780fa293485 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 204 len: 0 microversion: 2.1 time: 0.316275 Jun 02 09:22:17.448243 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 489/999] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:22:17 2022] DELETE /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:22:17.458778 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:17.459519 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:17.466922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:17.467526 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:17.468521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:17.469137 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:17.601803 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:17.609649 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c86339e8-2135-424c-ac07-b70599d0465e tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.156173 Jun 02 09:22:17.610308 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 511/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:17 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:18.628961 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:18.629652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:18.636379 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:18.636854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:18.637609 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:18.638039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:18.770159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:18.778301 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c6149029-2b11-454e-b3f4-77372da3a434 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1569 microversion: 2.1 time: 0.153102 Jun 02 09:22:18.778875 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 490/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:18 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:19.795924 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:19.796472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:19.802905 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:19.803384 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:19.804150 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:19.804585 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:20.016883 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:20.024455 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d2cd343c-282f-443b-b960-ae9cb0d639da tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1450 microversion: 2.1 time: 0.232971 Jun 02 09:22:20.025029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 512/1002] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:19 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1450 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:20.386216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-43d30e3b-d612-4491-afa7-9ad71fdca6be req-1610be22-1e33-4306-bfcd-e1e461e26a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca180fc-3453-47de-a315-d0d1630219de", "name": "network-vif-deleted", "tag": "eab5719d-8b78-45c0-a2ee-46ca3bdb2a99"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:20.394911 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-43d30e3b-d612-4491-afa7-9ad71fdca6be req-1610be22-1e33-4306-bfcd-e1e461e26a4f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:20.395387 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-43d30e3b-d612-4491-afa7-9ad71fdca6be req-1610be22-1e33-4306-bfcd-e1e461e26a4f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:20.406953 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-43d30e3b-d612-4491-afa7-9ad71fdca6be req-1610be22-1e33-4306-bfcd-e1e461e26a4f service nova] Creating event network-vif-deleted:eab5719d-8b78-45c0-a2ee-46ca3bdb2a99 for instance fca180fc-3453-47de-a315-d0d1630219de on hv-cinder-82549 Jun 02 09:22:20.411754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-43d30e3b-d612-4491-afa7-9ad71fdca6be req-1610be22-1e33-4306-bfcd-e1e461e26a4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029371 Jun 02 09:22:20.412332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 491/1003] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:21.041743 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:21.042372 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:21.049029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.049505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.050269 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.050748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.113609 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d38aab25eca47c888d3add258ce3cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec06218a20940509976a1e656176d9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:21.121090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-db544186-1db3-4993-a9f7-f7037da6895c tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 200 len: 1220 microversion: 2.1 time: 0.083297 Jun 02 09:22:21.121655 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 513/1004] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:21 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:21.247432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ca573fc-be58-452e-8029-a53a1dd66026"}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:21.248632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:21.254721 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.255165 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.255952 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.256408 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.335594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: POST /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments HTTP/1.1 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 74 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:22:21.337393 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {"volumeAttachment": {"volumeId": "7ca573fc-be58-452e-8029-a53a1dd66026"}} Jun 02 09:22:21.339095 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'server_id': '27392eff-38f5-494d-abb4-caf3926d2ca5', 'body': {'volumeAttachment': {'volumeId': '7ca573fc-be58-452e-8029-a53a1dd66026'}}} Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:22:21.340094 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:21.341813 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 400 to user: Invalid volume: volume 7ca573fc-be58-452e-8029-a53a1dd66026 is already attached to instances: 27392eff-38f5-494d-abb4-caf3926d2ca5 {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3eb1ee45-855b-4dae-a8d8-853a12eee9ea tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096313 Jun 02 09:22:21.343399 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 492/1005] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:22:21 2022] POST /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 09:22:21.398898 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:21.399563 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:21.405728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.406185 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.406962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.407440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.489981 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'services' on Instance uuid 27392eff-38f5-494d-abb4-caf3926d2ca5 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:22:21.686855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-404ab59f-5cd3-4aa4-9345-9dfc92591900 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments/7ca573fc-be58-452e-8029-a53a1dd66026" status: 202 len: 0 microversion: 2.1 time: 0.291680 Jun 02 09:22:21.687490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 514/1006] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:22:21 2022] DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments/7ca573fc-be58-452e-8029-a53a1dd66026 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:22:21.695802 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:21.696676 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:21.704190 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.704643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.705427 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:21.705868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:21.734914 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e6e9f41b-8086-49a0-b473-b6a099461744 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043101 Jun 02 09:22:21.735505 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 493/1007] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:22:21 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:22.139480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:22.140208 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] [instance: fca180fc-3453-47de-a315-d0d1630219de] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:22.146872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:22.147350 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:22.148107 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:22.148537 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:22.162235 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] HTTP exception thrown: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Request method failure captured: Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de HTTP/1.1 Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimIApaYyxgAKyv-9caUNRNsd8w8Pxr8uojF0Geu8GWTens6y_zm0kWjgp5O0cUmFkysNDkYY8MqxvacWXF2TiLfWjWu2AIOBtH9thbYjePrXP4ugUhToGrhr6dYSyW8vRO9VZ5qpjYn8Mm1Z-2xZpcDa_4V00WWbfsvvpflOKUC_ElVs Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 5ec06218a20940509976a1e656176d9b Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-TestShelveInstance-1216236671 Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:22:22.163866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ec06218a20940509976a1e656176d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5ec06218a20940509976a1e656176d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5ec06218a20940509976a1e656176d9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5ec06218a20940509976a1e656176d9b", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-TestShelveInstance-1216236671 Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 5ec06218a20940509976a1e656176d9b Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-TestShelveInstance-1216236671 Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-TestShelveInstance-1216236671-project Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 5d38aab25eca47c888d3add258ce3cff Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-TestShelveInstance-1216236671-project Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. Jun 02 09:22:22.165531 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'fca180fc-3453-47de-a315-d0d1630219de'} Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:22:22.166398 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. Jun 02 09:22:22.167956 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:22.169370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Returning 404 to user: Instance fca180fc-3453-47de-a315-d0d1630219de could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:22:22.169370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4e50f992-fa10-4ece-a32c-2e847a1b5ffa tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de" status: 404 len: 111 microversion: 2.1 time: 0.030533 Jun 02 09:22:22.169370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 515/1008] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:22 2022] GET /compute/v2.1/servers/fca180fc-3453-47de-a315-d0d1630219de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:22:22.401426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-4123bbfd-a223-43b2-8d0b-789462b04c49 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] Calling method '.version_select at 0x7f96717a8af0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:22.511744 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-4123bbfd-a223-43b2-8d0b-789462b04c49 tempest-TestShelveInstance-1216236671 tempest-TestShelveInstance-1216236671-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1041487610" status: 202 len: 0 microversion: 2.1 time: 0.114215 Jun 02 09:22:22.516323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 494/1009] 10.222.0.18 () {58 vars in 1253 bytes} [Thu Jun 2 09:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1041487610 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:22:22.745978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:22.747490 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:22.753564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:22.754091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:22.754888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:22.755351 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:22.785281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-07c8fb2a-56fa-445e-8e6c-cb019fc716c8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043316 Jun 02 09:22:22.785836 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 516/1010] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:22:22 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:22:23.797340 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:23.798364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:23.805242 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:23.805769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:23.806603 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:23.807131 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:23.840183 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7eb58339-9612-4c13-a12b-7fcb3cfacb53 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046773 Jun 02 09:22:23.841566 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 495/1011] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:22:23 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:22:23.915037 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:23.915667 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:23.924706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:23.925556 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:23.926716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:23.928029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:23.958584 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:22:24.179499 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-e6afa1dd-46b6-490c-aea4-7c24ff7285a9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 204 len: 0 microversion: 2.1 time: 0.267963 Jun 02 09:22:24.180091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 517/1012] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:22:23 2022] DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:22:24.189877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:24.190507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:24.196558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:24.197004 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:24.197768 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:24.198320 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:24.432594 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:24.441492 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a1ed01bc-4a48-4173-9b91-1bb3d29bf669 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1679 microversion: 2.1 time: 0.255800 Jun 02 09:22:24.442060 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 496/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:24 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1679 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:25.459901 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:25.461155 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:25.468216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:25.468661 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:25.469654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:25.470090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:25.607572 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:25.615728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bad0b9d5-158f-462c-9235-20077027e110 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1679 microversion: 2.1 time: 0.160191 Jun 02 09:22:25.617044 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 518/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:25 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:26.634118 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:26.635403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:26.643015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:26.643499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:26.644281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:26.644712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:26.833502 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:26.842807 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-90123300-c581-4275-b081-84b36f0a5ad0 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1679 microversion: 2.1 time: 0.212719 Jun 02 09:22:26.843410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 497/1015] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:26 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:27.196892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-4c74031a-ccaf-4f00-b5cf-6bcdb77689b1 req-7ef17ff1-08ab-4f09-9d4f-33133412277a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27392eff-38f5-494d-abb4-caf3926d2ca5", "name": "network-vif-deleted", "tag": "c142dc1f-76a9-45bb-a29a-c013226439d1"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:27.209066 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-4c74031a-ccaf-4f00-b5cf-6bcdb77689b1 req-7ef17ff1-08ab-4f09-9d4f-33133412277a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:27.211002 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-4c74031a-ccaf-4f00-b5cf-6bcdb77689b1 req-7ef17ff1-08ab-4f09-9d4f-33133412277a service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:27.221271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-4c74031a-ccaf-4f00-b5cf-6bcdb77689b1 req-7ef17ff1-08ab-4f09-9d4f-33133412277a service nova] Creating event network-vif-deleted:c142dc1f-76a9-45bb-a29a-c013226439d1 for instance 27392eff-38f5-494d-abb4-caf3926d2ca5 on hv-cinder-82549 Jun 02 09:22:27.226387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-4c74031a-ccaf-4f00-b5cf-6bcdb77689b1 req-7ef17ff1-08ab-4f09-9d4f-33133412277a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040035 Jun 02 09:22:27.227373 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 519/1016] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:27.860904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:27.861510 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:27.868500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:27.869038 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:27.869890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:27.870400 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:27.922701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:27.922701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:27.922701 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'fault' on Instance uuid 27392eff-38f5-494d-abb4-caf3926d2ca5 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:22:27.985789 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:27.997221 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c5541e49-02ef-4eaa-9a71-658aef2c2e8b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 200 len: 1331 microversion: 2.1 time: 0.140929 Jun 02 09:22:27.998180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 498/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:27 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:29.015497 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:29.016128 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:29.022580 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:29.023031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:29.023857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:29.024300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:29.037813 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 HTTP/1.1 Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:22:29.039525 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:22:29.041278 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '27392eff-38f5-494d-abb4-caf3926d2ca5'} Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:22:29.042504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:22:29.044902 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:22:29.049242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:22:29.049242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-1e1d412d-b4a2-4880-9959-e8b318e420f6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jun 02 09:22:29.049242 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 520/1018] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:29 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:22:29.050525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d6e1b05d-9f60-4825-8dec-4cdef8b45cbd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '.version_select at 0x7f96702795e0>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:29.128856 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d6e1b05d-9f60-4825-8dec-4cdef8b45cbd tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061027554" status: 202 len: 0 microversion: 2.1 time: 0.082072 Jun 02 09:22:29.129757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 499/1019] 10.222.0.18 () {58 vars in 1220 bytes} [Thu Jun 2 09:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061027554 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:22:30.020472 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4d78e7d9-b2ee-4315-b80b-eb1119748953 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: .version_select at 0x7f9670072ee0>, body: {"keypair": {"name": "tempest-keypair-726110561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKI2ujG0IfkpdwTRyd7bWXvfGC3eJIm2iDZvObv5SIG3/zOhoRdr/b2j81ij59CVO1DbXOwsZ6OrjUDznjUJQCtNZaiZIgp+qJqqHSJA8JtOxLHfi7mZt2nL2UvDOpPrQ=="}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:30.036942 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4d78e7d9-b2ee-4315-b80b-eb1119748953 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:22:30.040866 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-4d78e7d9-b2ee-4315-b80b-eb1119748953 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'key_pairs'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:22:30.123355 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4d78e7d9-b2ee-4315-b80b-eb1119748953 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106622 Jun 02 09:22:30.124346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 521/1020] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:22:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:22:32.584410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-837783844", "imageRef": "73d1738a-f846-41fa-a45a-b51f2ba572b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568ba997-047d-4381-9ac9-da024d18d18a"}], "security_groups": [{"name": "tempest-securitygroup--1772851373"}], "key_name": "tempest-keypair-726110561", "user_data": "}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:32.690792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] validate_networks() for [('568ba997-047d-4381-9ac9-da024d18d18a', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:22:33.065360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:22:33.065835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:22:33.066360 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:22:33.066767 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:22:33.067176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:22:33.077064 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:33.077507 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:33.078335 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:33.078769 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:33.096168 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:22:33.100530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Getting quotas for user 7fec67e95dbe4394a1ae15469f2a282f and project 8a9d7d82538e45f7a021dd27b6203f9a. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:22:33.111736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:22:33.114023 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73d1738a-f846-41fa-a45a-b51f2ba572b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:22:33.209635 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-761d0634-a997-4a2b-9a9a-15e1561de62a tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630190 Jun 02 09:22:33.210267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 500/1021] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:22:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:22:33.221202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-fd903128-73fb-48b0-a5bc-826795226d55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:33.221806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-fd903128-73fb-48b0-a5bc-826795226d55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:33.286638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-fd903128-73fb-48b0-a5bc-826795226d55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:33.295824 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-fd903128-73fb-48b0-a5bc-826795226d55 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1240 microversion: 2.1 time: 0.078883 Jun 02 09:22:33.296623 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 522/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:33 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:34.313553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:34.314163 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:34.322463 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:34.322463 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:34.322463 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:34.322847 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:34.391495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:34.398898 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0b840235-1dc9-4fe2-ab10-140a974e69d1 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1244 microversion: 2.1 time: 0.089714 Jun 02 09:22:34.399843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 501/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:34 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:35.416365 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:35.417014 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:35.423684 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:35.428549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:35.428549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:35.428549 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:35.549232 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:35.556847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-083e4102-519b-43a6-8a0a-388fed4785e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1300 microversion: 2.1 time: 0.144379 Jun 02 09:22:35.566862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 523/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:35 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1300 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:36.574110 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:36.575295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:36.582201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:36.582680 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:36.583591 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:36.584059 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:36.684524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:36.691742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b9c76ed0-74c5-4739-9674-fea4b59eb597 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1298 microversion: 2.1 time: 0.121537 Jun 02 09:22:36.692308 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 502/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:36 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:37.710872 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:37.713423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:37.720840 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:37.721719 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:37.722818 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:37.723457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:38.043644 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:38.055058 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-08d0fc97-18c3-42df-a044-37e654d0b09c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.349073 Jun 02 09:22:38.056521 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 524/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:37 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:38.292495 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-60a47af8-a42b-4316-a4eb-9ce0e4cb8990 req-8388edaf-2907-4a46-beed-cada7a01ca8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c83812-ae9b-4f52-9906-59053138bdf7", "tag": "348c86d9-26c0-481a-a4a0-be343128cb3c"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:38.306015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-60a47af8-a42b-4316-a4eb-9ce0e4cb8990 req-8388edaf-2907-4a46-beed-cada7a01ca8b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:38.306462 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-60a47af8-a42b-4316-a4eb-9ce0e4cb8990 req-8388edaf-2907-4a46-beed-cada7a01ca8b service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:38.334098 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-60a47af8-a42b-4316-a4eb-9ce0e4cb8990 req-8388edaf-2907-4a46-beed-cada7a01ca8b service nova] Creating event network-changed:348c86d9-26c0-481a-a4a0-be343128cb3c for instance 72c83812-ae9b-4f52-9906-59053138bdf7 on hv-cinder-82549 Jun 02 09:22:38.348329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-60a47af8-a42b-4316-a4eb-9ce0e4cb8990 req-8388edaf-2907-4a46-beed-cada7a01ca8b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059629 Jun 02 09:22:38.352481 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 503/1027] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:39.073722 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:39.075546 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:39.090995 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:39.092159 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:39.093817 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:39.094792 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:39.357695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:39.368850 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-81bb2758-27a6-4602-8ffb-6e7d0b94f817 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.298808 Jun 02 09:22:39.369907 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 525/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:39 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:40.388848 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:40.390370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:40.396983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:40.397511 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:40.398626 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:40.399009 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:40.541421 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:40.549429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5a7041fe-cfb0-4fc8-8cb8-09c5c6462d9f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.165868 Jun 02 09:22:40.550323 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 504/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:40 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:41.566958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:41.567598 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:41.575480 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:41.575927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:41.576740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:41.577347 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:41.596979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:41.717346 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:41.725126 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4112f635-d39a-4857-8db5-ac49b7f90ce9 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.161984 Jun 02 09:22:41.725717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 526/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:41 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:42.742709 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:42.743667 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:42.750260 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:42.750795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:42.751660 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:42.752159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:42.942430 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:42.952479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1eb7da6b-54a8-4f05-8032-0bbdc2db9376 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.213603 Jun 02 09:22:42.953145 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 505/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:42 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:43.670099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:43.974435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:43.976326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:43.986286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:43.994329 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:44.004763 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:44.005314 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:44.006286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:44.006796 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:44.052022 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-52e0c33b-43be-4296-8461-a68622bffc0b req-f36eaeeb-8403-470a-9fe7-54cdd305e062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c83812-ae9b-4f52-9906-59053138bdf7", "name": "network-vif-plugged", "status": "completed", "tag": "348c86d9-26c0-481a-a4a0-be343128cb3c"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:44.064136 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-52e0c33b-43be-4296-8461-a68622bffc0b req-f36eaeeb-8403-470a-9fe7-54cdd305e062 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:44.064952 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-52e0c33b-43be-4296-8461-a68622bffc0b req-f36eaeeb-8403-470a-9fe7-54cdd305e062 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:44.077861 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-52e0c33b-43be-4296-8461-a68622bffc0b req-f36eaeeb-8403-470a-9fe7-54cdd305e062 service nova] Creating event network-vif-plugged:348c86d9-26c0-481a-a4a0-be343128cb3c for instance 72c83812-ae9b-4f52-9906-59053138bdf7 on hv-cinder-82549 Jun 02 09:22:44.083977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-52e0c33b-43be-4296-8461-a68622bffc0b req-f36eaeeb-8403-470a-9fe7-54cdd305e062 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418453 Jun 02 09:22:44.084611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 527/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:44.362014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:44.362014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:44.362014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-502a5c50-49e9-449a-a01d-18ff840a0851 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.386509 Jun 02 09:22:44.362014 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 506/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:43 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:45.373370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:45.375083 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:45.384915 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:45.385460 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:45.386552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:45.387170 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:45.619643 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:45.627972 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-4872bcb4-f09a-4b32-8021-b8b30c675574 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1366 microversion: 2.1 time: 0.261317 Jun 02 09:22:45.628897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 528/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:45 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:46.375766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-47b31148-df0d-49b6-b8e0-c35360a8261d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Action: 'create', calling method: .version_select at 0x7f96701ae940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2000011494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK83e2qdKXF6XDsjidSAVlxaNNm4loFiJFxznaAo+Cvl+H8F+lV/j0NG7b50F6QdH1zxTNMBBMlXGztrisCYkVO6iMZFdEKcRZ0VQDavGyOxyVPfo49P/dshSD5hqfD+xg=="}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:46.391912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-47b31148-df0d-49b6-b8e0-c35360a8261d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for project 9808f004162146c089568a0261f09d59. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:22:46.401134 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-47b31148-df0d-49b6-b8e0-c35360a8261d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for user 97d63985256745499be671657584f271 and project 9808f004162146c089568a0261f09d59. Resources: {'key_pairs'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:22:46.545487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-47b31148-df0d-49b6-b8e0-c35360a8261d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.280525 Jun 02 09:22:46.546339 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 507/1035] 10.222.0.18 () {60 vars in 1158 bytes} [Thu Jun 2 09:22:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:46.645706 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:46.646319 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:46.648763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:22:46.654072 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:46.654520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:46.655330 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:46.655753 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:46.808934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:22:46.816912 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2a63ee1c-68ea-41a7-bedd-5e2504e9fa74 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1556 microversion: 2.1 time: 0.175193 Jun 02 09:22:46.821271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 529/1036] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:22:46 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:22:46.833753 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:22:46.834247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:22:46.841626 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:46.842078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:46.843080 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:46.843560 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:46.925690 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2a3756ed-f8f0-42d7-8d2e-6399c95eb8f2 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095841 Jun 02 09:22:46.926275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 508/1037] 10.222.0.18 () {58 vars in 1274 bytes} [Thu Jun 2 09:22:46 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:22:48.334273 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-ab415cfe-0aa6-4e8b-b00c-3f7bc3fd7ff5 req-3f254063-538b-47ce-a350-c8c1af567391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c83812-ae9b-4f52-9906-59053138bdf7", "tag": "348c86d9-26c0-481a-a4a0-be343128cb3c"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:22:48.344105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-ab415cfe-0aa6-4e8b-b00c-3f7bc3fd7ff5 req-3f254063-538b-47ce-a350-c8c1af567391 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:22:48.344665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-ab415cfe-0aa6-4e8b-b00c-3f7bc3fd7ff5 req-3f254063-538b-47ce-a350-c8c1af567391 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:22:48.363869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-ab415cfe-0aa6-4e8b-b00c-3f7bc3fd7ff5 req-3f254063-538b-47ce-a350-c8c1af567391 service nova] Creating event network-changed:348c86d9-26c0-481a-a4a0-be343128cb3c for instance 72c83812-ae9b-4f52-9906-59053138bdf7 on hv-cinder-82549 Jun 02 09:22:48.370167 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-ab415cfe-0aa6-4e8b-b00c-3f7bc3fd7ff5 req-3f254063-538b-47ce-a350-c8c1af567391 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116293 Jun 02 09:22:48.372289 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 530/1038] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:05.897258 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:05.898057 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:05.898669 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=4 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:05.902475 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2009743774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2000011494", "security_groups": [{"name": "tempest-secgroup-smoke-723555431"}], "block_device_mapping_v2": [{"uuid": "d35f02b7-2333-4366-8c1c-da145441b235", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bf0875da-fcbc-4d29-ba2c-41417f172826"}]}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:06.014167 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] validate_networks() for [('bf0875da-fcbc-4d29-ba2c-41417f172826', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:23:06.488631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:23:06.489083 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:23:06.489558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:23:06.489966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:23:06.490375 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:23:06.499143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:06.499618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:06.500419 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:06.500854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:06.518300 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:23:06.522225 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for user 97d63985256745499be671657584f271 and project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:23:06.576632 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:23:06.578736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d35f02b7-2333-4366-8c1c-da145441b235',volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:23:06.979574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-8a027dbe-9702-4662-a791-0335246000eb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.083466 Jun 02 09:23:06.980509 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 509/1039] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:23:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:23:06.987986 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=18 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:06.988819 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:06.992806 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f86ca091-1e2e-44ef-8f54-e84dac88b0a4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:06.994343 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f86ca091-1e2e-44ef-8f54-e84dac88b0a4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:07.052151 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f86ca091-1e2e-44ef-8f54-e84dac88b0a4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:07.059089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f86ca091-1e2e-44ef-8f54-e84dac88b0a4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1095 microversion: 2.1 time: 0.072508 Jun 02 09:23:07.069279 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 531/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:06 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:08.076605 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:08.077164 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:08.084536 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:08.084987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:08.085783 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:08.086216 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:08.148976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:08.156743 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-bd929eb8-5f27-4608-bbeb-e5416768b49a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1145 microversion: 2.1 time: 0.083944 Jun 02 09:23:08.157311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 510/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:08 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:09.174180 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:09.175026 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:09.183099 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:09.183534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:09.184333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:09.184787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:09.264826 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:09.273084 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-838d5262-3edb-480e-90b9-4587762d7228 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1201 microversion: 2.1 time: 0.103171 Jun 02 09:23:09.273643 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 532/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:09 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1201 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:10.290175 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:10.290794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:10.297431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:10.297884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:10.298662 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:10.299618 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:10.498853 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:10.507429 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2287c34e-1fe1-41d8-a03f-bc3ca0fe5b57 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1278 microversion: 2.1 time: 0.220975 Jun 02 09:23:10.508015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 511/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:10 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:10.933033 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-9d094d21-1a52-42c3-9028-775ffa4a39ab req-fd9d0c59-ca0e-4f94-bc39-4d621434b75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3853824c-a320-4115-a9a6-76383642e26c", "tag": "44b866c7-7811-4cad-9f25-0a01021b5ec5"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:10.941971 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-9d094d21-1a52-42c3-9028-775ffa4a39ab req-fd9d0c59-ca0e-4f94-bc39-4d621434b75e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:10.942693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-9d094d21-1a52-42c3-9028-775ffa4a39ab req-fd9d0c59-ca0e-4f94-bc39-4d621434b75e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:10.955895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-9d094d21-1a52-42c3-9028-775ffa4a39ab req-fd9d0c59-ca0e-4f94-bc39-4d621434b75e service nova] Creating event network-changed:44b866c7-7811-4cad-9f25-0a01021b5ec5 for instance 3853824c-a320-4115-a9a6-76383642e26c on hv-cinder-82549 Jun 02 09:23:10.961205 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-9d094d21-1a52-42c3-9028-775ffa4a39ab req-fd9d0c59-ca0e-4f94-bc39-4d621434b75e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033889 Jun 02 09:23:10.962162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 533/1044] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:11.526486 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:11.527099 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:11.533558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:11.534006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:11.534779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:11.535212 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:11.737057 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:11.744373 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-79b1af9d-fa9c-4378-9076-43a075b6ac78 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.221709 Jun 02 09:23:11.744927 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 512/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:11 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:12.762977 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:12.763619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:12.770277 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:12.770728 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:12.771522 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:12.771962 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:12.903004 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:12.910447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-da528779-797d-4679-8b1d-9d23ce89f9e4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.152196 Jun 02 09:23:12.911018 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 534/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:12 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:13.927892 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:13.928860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:13.934985 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:13.935464 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:13.936229 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:13.936664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:14.067294 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:14.074758 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a72d5988-a06a-4bcd-98dc-f8fd6715a60c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.151405 Jun 02 09:23:14.075333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 513/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:13 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:23:15.091835 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:15.092448 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:15.098930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:15.099411 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:15.100178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:15.100615 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:15.233641 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:15.242024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f53d3815-5727-4137-a4d0-3163693d6a26 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.154003 Jun 02 09:23:15.242592 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 535/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:15 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:16.259086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:16.259652 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:16.265689 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:16.270077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:16.270077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:16.270077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:16.401542 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:16.409060 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-04e1ee06-7232-4bb2-80f4-6e48c5ac2e58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.154371 Jun 02 09:23:16.409608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 514/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:16 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:17.425638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:17.426249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:17.429013 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:17.433878 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:17.437831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:17.437831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:17.437831 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:17.563209 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:17.571160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-778609de-c42f-4ebd-9c8a-08c2414b415a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.149328 Jun 02 09:23:17.571751 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 536/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:17 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:18.588683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:18.589294 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:18.591100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:18.591803 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:18.597739 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:18.598182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:18.598938 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:18.599890 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:18.732116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:18.739630 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9b3f36d9-57d0-4e7c-a465-84b5e29842a9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.154801 Jun 02 09:23:18.740186 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 515/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:18 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:19.756014 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:19.756622 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:19.763314 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:19.763763 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:19.764522 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:19.764948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:19.897821 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:19.905300 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-bd553cfe-7c79-4f5d-b18a-fde29e11e4fd tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.153125 Jun 02 09:23:19.905895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 537/1052] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:19 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:20.922351 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:20.923021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:20.930263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:20.930711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:20.931500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:20.931930 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:21.057631 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:21.065537 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-278c79d9-5871-4810-8d70-0f03002e4cc9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.147037 Jun 02 09:23:21.066088 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 516/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:20 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:21.663646 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-c036f938-2525-4733-ab97-fcbdad0d1d09 req-e43e2c69-6c1e-4d5e-92b0-8acb85b76816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3853824c-a320-4115-a9a6-76383642e26c", "name": "network-vif-plugged", "status": "completed", "tag": "44b866c7-7811-4cad-9f25-0a01021b5ec5"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:21.671851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c036f938-2525-4733-ab97-fcbdad0d1d09 req-e43e2c69-6c1e-4d5e-92b0-8acb85b76816 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:21.672286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-c036f938-2525-4733-ab97-fcbdad0d1d09 req-e43e2c69-6c1e-4d5e-92b0-8acb85b76816 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:21.682791 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-c036f938-2525-4733-ab97-fcbdad0d1d09 req-e43e2c69-6c1e-4d5e-92b0-8acb85b76816 service nova] Creating event network-vif-plugged:44b866c7-7811-4cad-9f25-0a01021b5ec5 for instance 3853824c-a320-4115-a9a6-76383642e26c on hv-cinder-82549 Jun 02 09:23:21.687853 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-c036f938-2525-4733-ab97-fcbdad0d1d09 req-e43e2c69-6c1e-4d5e-92b0-8acb85b76816 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028113 Jun 02 09:23:21.688577 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 538/1054] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:22.082273 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:22.082883 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:22.089381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:22.089827 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:22.090597 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:22.091029 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:22.219671 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:22.227633 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-73b0e3f7-bae2-48f6-a5b5-584cd76a2306 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1266 microversion: 2.1 time: 0.149647 Jun 02 09:23:22.228188 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 517/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:22 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:23.245184 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:23.245820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:23.252520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:23.252965 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:23.253725 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:23.254154 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:23.389905 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:23.397452 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-aab0cc72-ebf8-4453-a8b1-b366639413e1 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1452 microversion: 2.1 time: 0.156617 Jun 02 09:23:23.398011 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 539/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:23 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:23.416735 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:23.417359 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:23.424555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:23.425006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:23.425777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:23.426257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:23.555772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:23.563465 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d8358ec5-3a2a-485d-aef4-adc42ef1ce28 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1452 microversion: 2.1 time: 0.150574 Jun 02 09:23:23.564037 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 518/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:23 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:24.755091 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:24.755676 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:24.761854 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:24.762302 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:24.763080 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:24.763619 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:24.786795 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-571c2dce-4d2b-4a58-892f-f85edfe5384e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/ips" status: 200 len: 149 microversion: 2.1 time: 0.035749 Jun 02 09:23:24.787393 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 540/1058] 10.222.0.18 () {58 vars in 1247 bytes} [Thu Jun 2 09:23:24 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:25.796370 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-fb08feb5-512f-48c5-a14d-a853dfb3d2a0 req-397b3d2a-7bb8-4ed7-afee-abdd411a5f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3853824c-a320-4115-a9a6-76383642e26c", "tag": "44b866c7-7811-4cad-9f25-0a01021b5ec5"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:25.805498 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-fb08feb5-512f-48c5-a14d-a853dfb3d2a0 req-397b3d2a-7bb8-4ed7-afee-abdd411a5f12 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:25.805928 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-fb08feb5-512f-48c5-a14d-a853dfb3d2a0 req-397b3d2a-7bb8-4ed7-afee-abdd411a5f12 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:25.817479 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-fb08feb5-512f-48c5-a14d-a853dfb3d2a0 req-397b3d2a-7bb8-4ed7-afee-abdd411a5f12 service nova] Creating event network-changed:44b866c7-7811-4cad-9f25-0a01021b5ec5 for instance 3853824c-a320-4115-a9a6-76383642e26c on hv-cinder-82549 Jun 02 09:23:25.822664 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-fb08feb5-512f-48c5-a14d-a853dfb3d2a0 req-397b3d2a-7bb8-4ed7-afee-abdd411a5f12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030520 Jun 02 09:23:25.823270 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 519/1059] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:26.352158 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9ba8f71-b2ba-4051-9577-79a5d82d1ca1"}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:26.355382 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:26.359865 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:26.360308 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:26.361671 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:26.362322 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:27.113286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-33c0996c-78c2-430a-9245-f199c164b10c tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "POST /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765144 Jun 02 09:23:27.114228 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 541/1060] 10.222.0.18 () {60 vars in 1322 bytes} [Thu Jun 2 09:23:26 2022] POST /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:34.691841 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:34.692432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:34.698586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:34.699036 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:34.699836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:34.700282 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:34.777451 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'services' on Instance uuid 72c83812-ae9b-4f52-9906-59053138bdf7 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:23:34.999116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e56e8d0f-4739-4bb9-817e-3a5f5eed7832 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments/a9ba8f71-b2ba-4051-9577-79a5d82d1ca1" status: 202 len: 0 microversion: 2.1 time: 0.312551 Jun 02 09:23:34.999737 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 520/1061] 10.222.0.18 () {58 vars in 1415 bytes} [Thu Jun 2 09:23:34 2022] DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments/a9ba8f71-b2ba-4051-9577-79a5d82d1ca1 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:23:35.010239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:35.011202 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:35.018665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:35.019112 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:35.019918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:35.020443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:35.050253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-73e21c32-11e2-423a-9467-01d4fd4c04e8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Jun 02 09:23:35.050809 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 542/1062] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:23:35 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:36.062935 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:36.064016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:36.065964 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:36.070960 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:36.071450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:36.072270 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:36.072708 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:36.076420 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:36.106130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9b0fc413-c64c-4b90-a920-6f8fd4d0cc17 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047991 Jun 02 09:23:36.106683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 521/1063] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:23:36 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:37.119507 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:37.120468 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:37.127441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.127834 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.128607 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.129138 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.134340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:37.160871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-66bacf22-8b5e-46fc-80c9-a0d84015a63e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045833 Jun 02 09:23:37.161417 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 543/1064] 10.222.0.18 () {58 vars in 1301 bytes} [Thu Jun 2 09:23:37 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 09:23:37.217904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:37.218418 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:37.226675 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.227117 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.227906 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.228336 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.254289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:23:37.503546 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b9a8c78e-6e18-4f4c-b65e-1bf45af7fe35 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 204 len: 0 microversion: 2.1 time: 0.289117 Jun 02 09:23:37.504123 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 522/1065] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:23:37 2022] DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:23:37.512541 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:37.513177 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:37.520445 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.520894 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.521657 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:37.522092 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:37.671447 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:37.679682 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-878a0e4a-74de-437e-874b-59d219928eb5 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1680 microversion: 2.1 time: 0.171058 Jun 02 09:23:37.680246 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 544/1066] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:37 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:38.698015 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:38.698711 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:38.705816 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:38.706263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:38.707030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:38.707494 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:38.833651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:38.841099 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3185db6f-d6bb-44b2-b286-09c42c78dbc6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1680 microversion: 2.1 time: 0.147315 Jun 02 09:23:38.841659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 523/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:38 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:39.858203 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:39.858844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:39.862093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=31 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:23:39.875869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:39.875869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:39.875869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:39.875869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:40.049082 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:40.056570 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7639b0cf-8859-4048-a182-f32330839f27 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1680 microversion: 2.1 time: 0.202223 Jun 02 09:23:40.059380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 545/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:39 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:23:40.388024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-e85a608a-c735-42ae-af9a-9800fb0e6574 req-ad0a4152-caee-40d3-8c03-34c9759e952f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c83812-ae9b-4f52-9906-59053138bdf7", "name": "network-vif-deleted", "tag": "348c86d9-26c0-481a-a4a0-be343128cb3c"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:23:40.397409 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e85a608a-c735-42ae-af9a-9800fb0e6574 req-ad0a4152-caee-40d3-8c03-34c9759e952f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:40.397966 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e85a608a-c735-42ae-af9a-9800fb0e6574 req-ad0a4152-caee-40d3-8c03-34c9759e952f service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:40.409659 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-e85a608a-c735-42ae-af9a-9800fb0e6574 req-ad0a4152-caee-40d3-8c03-34c9759e952f service nova] Creating event network-vif-deleted:348c86d9-26c0-481a-a4a0-be343128cb3c for instance 72c83812-ae9b-4f52-9906-59053138bdf7 on hv-cinder-82549 Jun 02 09:23:40.415041 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-e85a608a-c735-42ae-af9a-9800fb0e6574 req-ad0a4152-caee-40d3-8c03-34c9759e952f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030852 Jun 02 09:23:40.416003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 524/1069] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:23:41.073936 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:41.074576 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:41.082170 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:41.082613 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:41.083427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:41.083880 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:41.118081 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:41.118527 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:41.118979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lazy-loading 'fault' on Instance uuid 72c83812-ae9b-4f52-9906-59053138bdf7 {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:23:41.162182 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fec67e95dbe4394a1ae15469f2a282f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a9d7d82538e45f7a021dd27b6203f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:23:41.169844 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-f482ba3b-8870-44cc-a60d-1eb877de01ad tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 200 len: 1330 microversion: 2.1 time: 0.099661 Jun 02 09:23:41.170614 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 546/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:41 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:23:42.189755 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:42.190394 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:42.197106 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:42.197553 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:42.198321 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:42.198754 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:42.212162 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 HTTP/1.1 Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:23:42.213746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:42.215525 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '72c83812-ae9b-4f52-9906-59053138bdf7'} Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:42.216629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:42.218241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:42.220443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:42.220443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2fafe9c5-4a54-4b94-b68a-94b40b06b8e7 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 404 len: 111 microversion: 2.1 time: 0.029753 Jun 02 09:23:42.220443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 525/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:42 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:23:42.224423 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-c969b7b1-26d4-48fb-b5d9-359d5456017e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '.version_select at 0x7f9670090820>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:42.321069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-c969b7b1-26d4-48fb-b5d9-359d5456017e tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726110561" status: 202 len: 0 microversion: 2.1 time: 0.100271 Jun 02 09:23:42.321654 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 547/1072] 10.222.0.18 () {58 vars in 1217 bytes} [Thu Jun 2 09:23:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726110561 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:23:44.332621 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:44.333117 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:44.339947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:44.340402 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:44.341210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:44.341647 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:44.355485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 HTTP/1.1 Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:23:44.357046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.358724 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '72c83812-ae9b-4f52-9906-59053138bdf7'} Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:44.359720 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.361992 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.363575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:44.363575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-602b979f-0965-466f-bbd4-c6c9d6a00813 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 404 len: 111 microversion: 2.1 time: 0.029675 Jun 02 09:23:44.363575 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 526/1073] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:23:44 2022] DELETE /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:23:44.367851 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:44.368512 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 72c83812-ae9b-4f52-9906-59053138bdf7] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:44.375052 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:44.375558 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:44.376333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:44.376776 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:44.389965 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 HTTP/1.1 Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:23:44.392129 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.393777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '72c83812-ae9b-4f52-9906-59053138bdf7'} Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:44.394633 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. Jun 02 09:23:44.395934 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:44.397118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 72c83812-ae9b-4f52-9906-59053138bdf7 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:44.397118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-64e5954d-25cf-4fb0-b9da-042854feb739 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7" status: 404 len: 111 microversion: 2.1 time: 0.029968 Jun 02 09:23:44.397118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 548/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:44 2022] GET /compute/v2.1/servers/72c83812-ae9b-4f52-9906-59053138bdf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:23:45.660254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:45.660746 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:45.667327 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.667777 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.668538 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.668974 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.683120 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 HTTP/1.1 Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:23:45.684678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.686316 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '27392eff-38f5-494d-abb4-caf3926d2ca5'} Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:45.687275 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.688844 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.690829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:45.690829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7d666c9d-f6a4-4e3f-b5ca-837797194137 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 404 len: 111 microversion: 2.1 time: 0.030236 Jun 02 09:23:45.690829 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 527/1075] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:23:45 2022] DELETE /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:23:45.697056 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:45.697660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 27392eff-38f5-494d-abb4-caf3926d2ca5] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:45.705046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.705491 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.706435 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.706867 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.720765 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 HTTP/1.1 Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:23:45.722333 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.724016 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '27392eff-38f5-494d-abb4-caf3926d2ca5'} Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:45.728181 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. Jun 02 09:23:45.729727 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.731161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 27392eff-38f5-494d-abb4-caf3926d2ca5 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:45.731161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-b43ed114-5c6c-49ac-90c6-552fbba59d4f tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5" status: 404 len: 111 microversion: 2.1 time: 0.030460 Jun 02 09:23:45.731161 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 549/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:45 2022] GET /compute/v2.1/servers/27392eff-38f5-494d-abb4-caf3926d2ca5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:23:45.737231 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:45.737736 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:45.743956 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.744407 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.745208 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.745710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.761202 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 HTTP/1.1 Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:23:45.762766 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.764425 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '412f6bfb-f93c-4b96-b72c-29577c450255'} Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:45.768195 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.769799 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.771381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:45.771381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5ae856e9-2172-4315-89cf-dbc68b895ff8 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 404 len: 111 microversion: 2.1 time: 0.031403 Jun 02 09:23:45.771381 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 528/1077] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:23:45 2022] DELETE /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:23:45.772482 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:45.773086 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 412f6bfb-f93c-4b96-b72c-29577c450255] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:45.779031 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.779505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.780264 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:45.780695 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:45.794162 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 HTTP/1.1 Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:23:45.795674 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.797306 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '412f6bfb-f93c-4b96-b72c-29577c450255'} Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:45.801514 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. Jun 02 09:23:45.803069 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:45.804999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 412f6bfb-f93c-4b96-b72c-29577c450255 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:45.804999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-30ec2123-0ee8-4e09-a5db-a225f3e9972b tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255" status: 404 len: 111 microversion: 2.1 time: 0.028324 Jun 02 09:23:45.804999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 550/1078] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:45 2022] GET /compute/v2.1/servers/412f6bfb-f93c-4b96-b72c-29577c450255 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:23:47.057279 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:47.057812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:47.064328 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:47.064773 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:47.065540 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:47.065976 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:47.079784 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 HTTP/1.1 Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:23:47.081299 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.082983 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '5b12fb97-d295-483c-81da-cf21e9b57720'} Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:47.083810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.085180 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.086725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:47.086725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-831c61d9-9c8c-42a0-b919-25ea0c20b4a6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 404 len: 111 microversion: 2.1 time: 0.029343 Jun 02 09:23:47.086725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 529/1079] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:23:47 2022] DELETE /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:23:47.090895 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:23:47.091530 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] [instance: 5b12fb97-d295-483c-81da-cf21e9b57720] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:23:47.097958 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:47.098404 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:47.099170 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:23:47.099628 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:23:47.112771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] HTTP exception thrown: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Request method failure captured: Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 HTTP/1.1 Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimICGj-LXoj6GGmL8jCurpPxI7CsitJy5s0MCLkGRVAQZBNKUoacsqHe4uikHa2MXISaoWFAGSZOolQCnJj5ifDjJJhIfpQrl3iHLLgYu2DSnpzgtbTBIzX7OfH3yQCsTkCrYH9IN5RxdMyCUd2iegPVqzUzufbJMJvqPNWvEZo2Nucw Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:23:47.114260 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8a9d7d82538e45f7a021dd27b6203f9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8a9d7d82538e45f7a021dd27b6203f9a", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 8a9d7d82538e45f7a021dd27b6203f9a Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1028127942 Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 7fec67e95dbe4394a1ae15469f2a282f Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-AttachVolumeNegativeTest-1028127942-project Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.115892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '5b12fb97-d295-483c-81da-cf21e9b57720'} Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:23:47.116804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. Jun 02 09:23:47.118328 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:23:47.119717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] Returning 404 to user: Instance 5b12fb97-d295-483c-81da-cf21e9b57720 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:23:47.119717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-19863b02-8de1-4d86-9362-7c01f736afa6 tempest-AttachVolumeNegativeTest-1028127942 tempest-AttachVolumeNegativeTest-1028127942-project] 10.222.0.18 "GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720" status: 404 len: 111 microversion: 2.1 time: 0.028519 Jun 02 09:23:47.119717 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 551/1080] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:23:47 2022] GET /compute/v2.1/servers/5b12fb97-d295-483c-81da-cf21e9b57720 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 09:25:23.285296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:23.285958 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:23.289762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:23.290272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:23.296241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:23.296921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:23.297444 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:23.297875 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:23.323868 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:25:23.592040 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-6f3e8e2c-8dfe-4e8b-808a-0d0f831c3c6f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 204 len: 0 microversion: 2.1 time: 0.308822 Jun 02 09:25:23.592555 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 530/1081] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:25:23 2022] DELETE /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:25:23.598796 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:23.602496 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=33 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:23.604265 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:23.604897 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:23.611004 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:23.611564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:23.612869 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:23.613312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:23.743523 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:23.751027 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d770cd41-b80d-4e17-8fd0-e8c9e0b2ffe4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1577 microversion: 2.1 time: 0.154199 Jun 02 09:25:23.751613 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 552/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:23 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:24.770435 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:24.776042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:24.777760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:24.778209 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:24.779016 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:24.779648 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:24.917330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:24.925558 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d740d1c2-81d4-48fd-96e9-d380d840fb95 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1577 microversion: 2.1 time: 0.159454 Jun 02 09:25:24.926403 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 531/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:24 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:25.941957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:25.942573 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:25.949921 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:25.950367 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:25.951545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:25.951922 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:26.154159 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:26.162286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-799a1331-95a6-4179-a4c7-5a2b05b10443 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1577 microversion: 2.1 time: 0.224255 Jun 02 09:25:26.162856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 553/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:25 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:26.523006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-9887cddf-118c-4688-a6a3-070df5de6ccd req-52d5cdbc-cb63-438d-b58b-1f1aaf3743d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3853824c-a320-4115-a9a6-76383642e26c", "name": "network-vif-deleted", "tag": "44b866c7-7811-4cad-9f25-0a01021b5ec5"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:25:26.532138 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-9887cddf-118c-4688-a6a3-070df5de6ccd req-52d5cdbc-cb63-438d-b58b-1f1aaf3743d4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:26.537933 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-9887cddf-118c-4688-a6a3-070df5de6ccd req-52d5cdbc-cb63-438d-b58b-1f1aaf3743d4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:26.544043 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-9887cddf-118c-4688-a6a3-070df5de6ccd req-52d5cdbc-cb63-438d-b58b-1f1aaf3743d4 service nova] Creating event network-vif-deleted:44b866c7-7811-4cad-9f25-0a01021b5ec5 for instance 3853824c-a320-4115-a9a6-76383642e26c on hv-cinder-82549 Jun 02 09:25:26.548961 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-9887cddf-118c-4688-a6a3-070df5de6ccd req-52d5cdbc-cb63-438d-b58b-1f1aaf3743d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029778 Jun 02 09:25:26.550295 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 532/1085] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:25:27.180485 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:27.181863 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:27.188321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:27.189120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:27.190400 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:27.191014 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:27.226017 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:27.226742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:27.227420 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.objects.instance [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lazy-loading 'fault' on Instance uuid 3853824c-a320-4115-a9a6-76383642e26c {{(pid=118038) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:25:27.277114 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:27.286178 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-93eba84d-db84-4df1-9915-14aa59698335 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 200 len: 1231 microversion: 2.1 time: 0.109381 Jun 02 09:25:27.286776 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 554/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:27 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:28.303187 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:28.303862 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:28.310606 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:28.311052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:28.311872 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:28.312306 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:28.326922 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] HTTP exception thrown: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Request method failure captured: Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c HTTP/1.1 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimIFfMyl2nRl4D58ds6OENaO1QYAOxSS-XcosqbASwbjhUx3QXf5yNfhjxhy_0J6NZj7XTSVb8juWGuETC-mnzn97P4TdyiXpB0ZqP0nxCoiCCMx_I_4bfdgP2_fYaUCfZA8vPD8SoCyiylIK72XmpLvjOa5b5lb_kVOeG25NH6Wvc5c Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:25:28.328585 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9808f004162146c089568a0261f09d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9808f004162146c089568a0261f09d59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 97d63985256745499be671657584f271 Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:25:28.330277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '3853824c-a320-4115-a9a6-76383642e26c'} Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:25:28.331912 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:25:28.333266 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:25:28.334450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Returning 404 to user: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:25:28.334450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-2625d44f-8a60-44ef-a746-e725cf5ec965 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 404 len: 111 microversion: 2.1 time: 0.030963 Jun 02 09:25:28.334450 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 533/1087] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:28 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:25:28.424380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1859153240", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2000011494", "security_groups": [{"name": "tempest-secgroup-smoke-723555431"}], "block_device_mapping_v2": [{"uuid": "d35f02b7-2333-4366-8c1c-da145441b235", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bf0875da-fcbc-4d29-ba2c-41417f172826"}]}} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:25:28.540540 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.network.neutron [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] validate_networks() for [('bf0875da-fcbc-4d29-ba2c-41417f172826', None, None, None, None, None)] {{(pid=118038) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:25:29.278879 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:25:29.279332 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image limits 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:25:29.279804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:25:29.280207 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image pref 0:0:0 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:25:29.280651 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.virt.hardware [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118038) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:25:29.290638 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:29.291090 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:29.291946 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:29.292380 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:29.309168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:25:29.313088 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.quota [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for user 97d63985256745499be671657584f271 and project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118038) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:25:29.370174 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Going to run 1 instances... {{(pid=118038) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:25:29.372312 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d35f02b7-2333-4366-8c1c-da145441b235',volume_size=None,volume_type=None)] {{(pid=118038) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:25:29.804340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-7885b1c2-7dcb-48c7-945f-758a31e92b90 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.383865 Jun 02 09:25:29.804947 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 555/1088] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:25:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:25:29.814605 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-d72fb57c-bd27-401a-b995-d4333290ebaa tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:29.815333 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-d72fb57c-bd27-401a-b995-d4333290ebaa tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:29.869207 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-d72fb57c-bd27-401a-b995-d4333290ebaa tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:29.876142 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-d72fb57c-bd27-401a-b995-d4333290ebaa tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1095 microversion: 2.1 time: 0.065242 Jun 02 09:25:29.877079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 534/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:29 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:30.894964 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:30.895653 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:30.902394 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:30.903034 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:30.903616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:30.904050 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:30.965061 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:30.973406 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-01a4be9e-76e7-43e6-a9bc-c350f4410f33 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1145 microversion: 2.1 time: 0.083321 Jun 02 09:25:30.977225 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 556/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:30 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:31.990877 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:31.991770 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:31.998923 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:32.000047 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:32.000836 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:32.001277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:32.076987 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:32.084539 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-20e8c36b-2fbc-4622-9ed9-eb6c690c6df9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1211 microversion: 2.1 time: 0.098542 Jun 02 09:25:32.085332 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 535/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:31 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:33.102903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:33.103555 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:33.110042 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:33.119441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:33.119441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:33.119441 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:33.272948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:33.280479 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6673a4d9-825a-4c25-9d70-7dbb2d27fca6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1278 microversion: 2.1 time: 0.181819 Jun 02 09:25:33.281039 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 557/1092] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:33 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 09:25:33.678173 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-8c125a1d-e75f-482c-a02e-f0c16e4c0dfb req-9e33a9c4-22ac-45ec-909a-cd30608f7477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bc5982-7352-43b0-a25a-6b5df1738456", "tag": "e44d01e4-dc51-4f6d-b52b-ff3d27e15212"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:25:33.694772 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8c125a1d-e75f-482c-a02e-f0c16e4c0dfb req-9e33a9c4-22ac-45ec-909a-cd30608f7477 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:33.695330 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-8c125a1d-e75f-482c-a02e-f0c16e4c0dfb req-9e33a9c4-22ac-45ec-909a-cd30608f7477 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:33.707499 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-8c125a1d-e75f-482c-a02e-f0c16e4c0dfb req-9e33a9c4-22ac-45ec-909a-cd30608f7477 service nova] Creating event network-changed:e44d01e4-dc51-4f6d-b52b-ff3d27e15212 for instance 18bc5982-7352-43b0-a25a-6b5df1738456 on hv-cinder-82549 Jun 02 09:25:33.712723 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-8c125a1d-e75f-482c-a02e-f0c16e4c0dfb req-9e33a9c4-22ac-45ec-909a-cd30608f7477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039025 Jun 02 09:25:33.713413 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 536/1093] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 09:25:34.297261 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:34.297918 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:34.304343 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:34.304793 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:34.305583 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:34.306019 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:34.530683 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:34.538425 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-28f19974-a7aa-4362-a6e7-547747e05966 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.244999 Jun 02 09:25:34.539443 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 558/1094] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:34 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:35.555834 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:35.556540 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:35.563391 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:35.563843 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:35.564605 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:35.565046 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:35.701318 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:35.708252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-04a02af2-9e13-47a9-9786-fec2cd5b444c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.156625 Jun 02 09:25:35.708878 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 537/1095] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:35 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:36.725486 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:36.726089 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:36.732670 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:36.733100 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:36.733856 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:36.734281 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:36.865881 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:36.873788 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-74654717-384a-44e7-8333-8795dc2f7ec0 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.152533 Jun 02 09:25:36.874359 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 559/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:36 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:37.889896 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:37.890616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:37.897646 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:37.898092 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:37.898846 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:37.899300 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:38.034051 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:38.041567 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-362f05f2-c301-4ff1-809b-248da4a5ce9d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.155524 Jun 02 09:25:38.042116 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 538/1097] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:37 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:39.057783 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:39.058389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:39.065135 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:39.065580 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:39.066352 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:39.066782 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:39.194892 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:39.202407 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5649e199-1bb5-4b86-b02e-ec9b1c24d718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.148431 Jun 02 09:25:39.202976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 560/1098] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:39 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:40.218997 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:40.219665 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:40.222545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:40.227411 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:40.227858 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:40.228649 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:40.229074 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:40.358177 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:40.366150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-59991fc1-8ebf-4286-a6c9-d48b86136d84 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.151068 Jun 02 09:25:40.366712 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 539/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:40 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:41.383439 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:41.384035 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:41.385876 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:41.386545 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=6 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:25:41.391938 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:41.392386 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:41.393158 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:41.393593 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:41.528689 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:41.536199 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d5246720-cb2f-43f5-a822-d89029a26a58 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.157100 Jun 02 09:25:41.536787 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 561/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:41 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:42.552918 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:42.553520 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:42.560067 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:42.560513 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:42.561267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:42.561691 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:42.697263 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:42.704695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-c000c4b0-d876-4aba-8872-1691bf3fb57d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.155638 Jun 02 09:25:42.705186 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 540/1101] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:42 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:43.722589 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:43.723249 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:43.730168 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:43.730618 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:43.731428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:43.731868 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:43.862470 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:43.869999 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-55084dd2-8ccf-4eb4-ac61-2c596bf21adf tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.151931 Jun 02 09:25:43.870571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 562/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:43 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:44.405305 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-da894531-3f0e-416b-a523-f5b4c97eb4de req-e1a7ad5b-fb86-4281-b947-7147d742912e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bc5982-7352-43b0-a25a-6b5df1738456", "name": "network-vif-plugged", "status": "completed", "tag": "e44d01e4-dc51-4f6d-b52b-ff3d27e15212"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:25:44.413830 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-da894531-3f0e-416b-a523-f5b4c97eb4de req-e1a7ad5b-fb86-4281-b947-7147d742912e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:44.415489 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-da894531-3f0e-416b-a523-f5b4c97eb4de req-e1a7ad5b-fb86-4281-b947-7147d742912e service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:44.425544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-da894531-3f0e-416b-a523-f5b4c97eb4de req-e1a7ad5b-fb86-4281-b947-7147d742912e service nova] Creating event network-vif-plugged:e44d01e4-dc51-4f6d-b52b-ff3d27e15212 for instance 18bc5982-7352-43b0-a25a-6b5df1738456 on hv-cinder-82549 Jun 02 09:25:44.430598 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-da894531-3f0e-416b-a523-f5b4c97eb4de req-e1a7ad5b-fb86-4281-b947-7147d742912e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029019 Jun 02 09:25:44.431159 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 541/1103] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:25:44.887098 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:44.887742 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:44.895324 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:44.895862 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:44.896636 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:44.897073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:45.037428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:45.044820 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5b0697b6-7326-417d-8656-8ad358f69c5f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.161612 Jun 02 09:25:45.045387 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 563/1104] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:44 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:46.062626 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:46.063485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:46.070528 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:46.070986 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:46.071798 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:46.072241 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:46.206760 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:46.214699 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-07b37bcd-7597-408d-a481-09aa1dfe146b tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1266 microversion: 2.1 time: 0.156753 Jun 02 09:25:46.215811 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 542/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:46 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:47.233747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:47.234282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:47.241403 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:47.241855 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:47.242616 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:47.243057 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:47.373513 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:47.381029 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-eb345619-82af-43e3-8383-cccc264b9f69 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1453 microversion: 2.1 time: 0.151266 Jun 02 09:25:47.381852 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 564/1106] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:47 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:47.397593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:25:47.398296 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:25:47.404795 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:47.405247 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:47.406019 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:47.406487 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:47.535130 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:25:47.542639 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-3170ec25-d3b1-4b3f-b3ca-aa5cdd21998d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1453 microversion: 2.1 time: 0.149327 Jun 02 09:25:47.543198 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 543/1107] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:25:47 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:25:49.422248 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-2ffdb406-51e8-4bb6-b337-03a4aa022053 req-b8abd2f8-d939-4faf-9550-e7f792b6c60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bc5982-7352-43b0-a25a-6b5df1738456", "tag": "e44d01e4-dc51-4f6d-b52b-ff3d27e15212"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:25:49.430847 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2ffdb406-51e8-4bb6-b337-03a4aa022053 req-b8abd2f8-d939-4faf-9550-e7f792b6c60c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:25:49.431313 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-2ffdb406-51e8-4bb6-b337-03a4aa022053 req-b8abd2f8-d939-4faf-9550-e7f792b6c60c service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:25:49.442838 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-2ffdb406-51e8-4bb6-b337-03a4aa022053 req-b8abd2f8-d939-4faf-9550-e7f792b6c60c service nova] Creating event network-changed:e44d01e4-dc51-4f6d-b52b-ff3d27e15212 for instance 18bc5982-7352-43b0-a25a-6b5df1738456 on hv-cinder-82549 Jun 02 09:25:49.447983 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-2ffdb406-51e8-4bb6-b337-03a4aa022053 req-b8abd2f8-d939-4faf-9550-e7f792b6c60c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029414 Jun 02 09:25:49.450485 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 565/1108] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:26:13.217990 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:26:13.218574 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Thu Jun 2 09:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:27:36.777794 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:36.778545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:36.782401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1251286094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2000011494", "security_groups": [{"name": "tempest-secgroup-smoke-723555431"}], "block_device_mapping_v2": [{"uuid": "e0ffc16d-955a-4711-866e-832aff44e5aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bf0875da-fcbc-4d29-ba2c-41417f172826"}]}} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:27:37.078052 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.network.neutron [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] validate_networks() for [('bf0875da-fcbc-4d29-ba2c-41417f172826', None, None, None, None, None)] {{(pid=118037) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 09:27:37.442500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 09:27:37.442922 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image limits 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 09:27:37.443432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Flavor pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 09:27:37.443842 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Image pref 0:0:0 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 09:27:37.444253 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.virt.hardware [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118037) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 09:27:37.453236 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:37.453678 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:37.454470 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:37.454900 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:37.471526 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 09:27:37.475762 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.quota [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Getting quotas for user 97d63985256745499be671657584f271 and project 9808f004162146c089568a0261f09d59. Resources: {'instances', 'cores', 'ram'} {{(pid=118037) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 09:27:37.532000 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Going to run 1 instances... {{(pid=118037) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 09:27:37.534172 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0ffc16d-955a-4711-866e-832aff44e5aa',volume_size=None,volume_type=None)] {{(pid=118037) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 09:27:37.939750 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-9b4f6581-7118-4c5e-8888-e1a474549718 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.163491 Jun 02 09:27:37.945388 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 544/1109] 10.222.0.18 () {60 vars in 1146 bytes} [Thu Jun 2 09:27:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 09:27:37.948771 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12412c3a-50c8-4d50-94e0-3e9193851ea1] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 02 09:27:37.949371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:37.950105 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=78 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:37.954392 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-376f4cdd-d8bc-48d9-9722-41dc5de38cae tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:37.956845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-376f4cdd-d8bc-48d9-9722-41dc5de38cae tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:38.069477 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-376f4cdd-d8bc-48d9-9722-41dc5de38cae tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:38.077571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-376f4cdd-d8bc-48d9-9722-41dc5de38cae tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1095 microversion: 2.1 time: 0.129328 Jun 02 09:27:38.077571 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 566/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:37 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:39.092596 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:39.093205 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:39.099485 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:39.099943 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:39.100716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:39.101153 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:39.164967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:39.172433 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ce989b08-293b-47f4-a771-89c07a2556c6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1145 microversion: 2.1 time: 0.084220 Jun 02 09:27:39.172994 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 545/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:39 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:40.190076 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:40.191505 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:40.200773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:40.201257 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:40.202087 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:40.202534 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:40.210036 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] [12412c3a-50c8-4d50-94e0-3e9193851ea1] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 41864. Jun 02 09:27:40.432483 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:40.482930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-37a332e3-03b6-4bc2-94c4-620949df1888 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1201 microversion: 2.1 time: 0.255571 Jun 02 09:27:40.482930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 567/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:40 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1201 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:41.458476 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:41.464695 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:41.465692 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:41.466143 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:41.466916 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:41.467382 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:41.708378 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:41.715961 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-5ccd005b-c1c8-48a4-a219-aeed43481312 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1278 microversion: 2.1 time: 0.261917 Jun 02 09:27:41.716616 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 546/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:41 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:42.282524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-78bcef47-a2c8-40c0-9589-0869938078d7 req-ccadff19-61d1-4482-9990-b82755ed1d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ef4046-055e-46dc-b2ed-e43baa37d454", "tag": "30c99a41-70c0-4d1e-8ee8-f223aac7dcb2"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:27:42.292440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-78bcef47-a2c8-40c0-9589-0869938078d7 req-ccadff19-61d1-4482-9990-b82755ed1d13 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:42.292877 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-78bcef47-a2c8-40c0-9589-0869938078d7 req-ccadff19-61d1-4482-9990-b82755ed1d13 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:42.305207 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-78bcef47-a2c8-40c0-9589-0869938078d7 req-ccadff19-61d1-4482-9990-b82755ed1d13 service nova] Creating event network-changed:30c99a41-70c0-4d1e-8ee8-f223aac7dcb2 for instance d7ef4046-055e-46dc-b2ed-e43baa37d454 on hv-cinder-82549 Jun 02 09:27:42.316885 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-78bcef47-a2c8-40c0-9589-0869938078d7 req-ccadff19-61d1-4482-9990-b82755ed1d13 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103796 Jun 02 09:27:42.320449 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 568/1114] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:27:42.733286 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:42.733897 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:42.740588 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:42.741042 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:42.741833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:42.742281 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:42.874904 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:42.882969 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-45549e99-6ea2-4fdb-950f-483dfe125467 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.153515 Jun 02 09:27:42.883569 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 547/1115] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:42 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:43.900340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:43.901039 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:43.907377 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:43.907829 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:43.908594 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:43.909559 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:44.040340 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:44.047740 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-a397a7ac-4188-4d30-9c31-907c9959fa40 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.152131 Jun 02 09:27:44.048301 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 569/1116] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:43 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:44.859552 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:27:44.859799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:27:45.064725 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:45.065940 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:45.072344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:45.072792 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:45.073544 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:45.073981 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:45.203062 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:45.210500 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-24ac1e1b-419c-4731-b977-d910f90b817c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.149622 Jun 02 09:27:45.211072 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 548/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:45 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:46.226532 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:46.227073 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:46.233715 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:46.234160 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:46.234917 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:46.235457 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:46.365608 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:46.372968 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-03ca5c61-ee26-40e8-8ecd-a4471a82504d tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.150342 Jun 02 09:27:46.373519 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 570/1118] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:46 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:47.442300 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:47.442921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:47.448967 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:47.449395 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:47.450157 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:47.450593 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:47.465468 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=2 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:47.482643 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell0:SELECT=6 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:47.579257 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:47.587267 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e841d27c-4e3d-4b5b-bffa-c6bce9bc444a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.200824 Jun 02 09:27:47.587833 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 549/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:47 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:48.603768 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:48.604309 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:48.606681 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell0:SELECT=2 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:27:48.611535 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:48.615632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:48.615632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:48.615632 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:48.743748 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:48.751062 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-3c3b0222-ff95-4574-a17f-31778dfc71d4 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.151175 Jun 02 09:27:48.751661 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 571/1120] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:48 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:49.769199 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:49.769854 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:49.776432 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:49.776884 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:49.777651 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:49.778086 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:49.905484 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:49.912863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1a90733b-ed27-4bd5-b8e3-a498e4fcf52f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.147992 Jun 02 09:27:49.913426 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 550/1121] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:49 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:50.929417 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:50.930030 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:50.936564 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:50.937014 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:50.937777 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:50.938213 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:51.069216 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:51.076212 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d486241c-0e0e-4630-b1cd-b294986dd240 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.150659 Jun 02 09:27:51.076804 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 572/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:50 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:52.093439 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:52.094049 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:52.101135 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:52.101583 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:52.102348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:52.102781 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:52.231428 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:52.239404 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-31c6b6ff-0cde-4b2c-877e-679ddd42687a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.149794 Jun 02 09:27:52.239958 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 551/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:52 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:53.256930 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:53.257481 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:53.263978 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:53.264427 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:53.265193 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:53.265626 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:53.394957 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:53.400395 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-20b5df49-1420-46a2-900c-b8ed8f6ba8e6 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.148277 Jun 02 09:27:53.400982 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 573/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:53 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:54.417039 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:54.417650 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:54.424189 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:54.424637 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:54.425401 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:54.425835 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:54.565068 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:54.572443 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-698bb2c8-4f25-4097-bed7-3f552ad642a3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.159214 Jun 02 09:27:54.572996 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 552/1125] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:54 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:55.001976 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-e842c0d8-e0a2-47e8-b186-fbdb985b030c req-79396432-5e9b-4391-be17-6dfd418273c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ef4046-055e-46dc-b2ed-e43baa37d454", "name": "network-vif-plugged", "status": "completed", "tag": "30c99a41-70c0-4d1e-8ee8-f223aac7dcb2"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:27:55.010891 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-e842c0d8-e0a2-47e8-b186-fbdb985b030c req-79396432-5e9b-4391-be17-6dfd418273c4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:55.011369 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-e842c0d8-e0a2-47e8-b186-fbdb985b030c req-79396432-5e9b-4391-be17-6dfd418273c4 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:55.022021 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-e842c0d8-e0a2-47e8-b186-fbdb985b030c req-79396432-5e9b-4391-be17-6dfd418273c4 service nova] Creating event network-vif-plugged:30c99a41-70c0-4d1e-8ee8-f223aac7dcb2 for instance d7ef4046-055e-46dc-b2ed-e43baa37d454 on hv-cinder-82549 Jun 02 09:27:55.027211 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-e842c0d8-e0a2-47e8-b186-fbdb985b030c req-79396432-5e9b-4391-be17-6dfd418273c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080613 Jun 02 09:27:55.027849 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 574/1126] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:27:55.589716 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:55.590326 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:55.597473 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:55.597920 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:55.598683 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:55.599118 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:55.729821 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:55.737192 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-b68ccb7e-a59e-452a-a9bf-2154bbc8b00c tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.151299 Jun 02 09:27:55.737742 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 553/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:55 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:56.754253 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:56.754951 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:56.761389 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:56.761842 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:56.762611 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:56.763046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:56.892240 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:56.900124 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-818c9773-1f5f-4b63-b7b7-e8697af939dc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1266 microversion: 2.1 time: 0.150658 Jun 02 09:27:56.900913 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 575/1128] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:56 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:57.916971 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:57.917608 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:57.924860 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:57.925307 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:57.926078 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:57.926515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:58.058156 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:58.065697 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-e244f3d2-152e-40d6-aca5-c45cc43e7cf3 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1453 microversion: 2.1 time: 0.152574 Jun 02 09:27:58.066252 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 554/1129] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:57 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:58.081587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:27:58.085520 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:27:58.088827 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:58.089282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:58.090051 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:27:58.090492 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:27:58.222108 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:27:58.229551 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2da9576d-e123-4858-a6fa-2fe540c8e0bc tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1453 microversion: 2.1 time: 0.151833 Jun 02 09:27:58.230120 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 576/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:27:58 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:27:58.677311 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:27:58.677497 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Thu Jun 2 09:27:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:28:00.320289 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-e6cac939-7840-40fd-b9e0-2bf9c0d32110 req-be7c6868-57a8-4493-b455-8b84544bebea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ef4046-055e-46dc-b2ed-e43baa37d454", "tag": "30c99a41-70c0-4d1e-8ee8-f223aac7dcb2"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:28:00.328728 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e6cac939-7840-40fd-b9e0-2bf9c0d32110 req-be7c6868-57a8-4493-b455-8b84544bebea service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:28:00.329176 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-e6cac939-7840-40fd-b9e0-2bf9c0d32110 req-be7c6868-57a8-4493-b455-8b84544bebea service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:28:00.340470 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-e6cac939-7840-40fd-b9e0-2bf9c0d32110 req-be7c6868-57a8-4493-b455-8b84544bebea service nova] Creating event network-changed:30c99a41-70c0-4d1e-8ee8-f223aac7dcb2 for instance d7ef4046-055e-46dc-b2ed-e43baa37d454 on hv-cinder-82549 Jun 02 09:28:00.345515 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-e6cac939-7840-40fd-b9e0-2bf9c0d32110 req-be7c6868-57a8-4493-b455-8b84544bebea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028844 Jun 02 09:28:00.346628 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 555/1131] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:29:26.430152 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:29:26.430739 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:29:33.850130 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:33.850750 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:33.851146 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:33.851455 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG dbcounter [-] [118037] Writing DB stats nova_cell1:SELECT=64 {{(pid=118037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:33.853271 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_api:SELECT=24 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:33.853927 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG dbcounter [-] [118038] Writing DB stats nova_cell1:SELECT=52 {{(pid=118038) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:29:33.861720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:33.861720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:33.861720 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:33.862362 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:33.890173 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Going to try to terminate instance {{(pid=118038) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:29:33.913433 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-46b5e7e2-f920-40f3-9c7d-942b07a7e42f req-6dec5b5c-698d-4d56-bf64-0f7e9faccb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ef4046-055e-46dc-b2ed-e43baa37d454", "tag": "30c99a41-70c0-4d1e-8ee8-f223aac7dcb2"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:29:33.922810 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-46b5e7e2-f920-40f3-9c7d-942b07a7e42f req-6dec5b5c-698d-4d56-bf64-0f7e9faccb80 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:33.923570 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-46b5e7e2-f920-40f3-9c7d-942b07a7e42f req-6dec5b5c-698d-4d56-bf64-0f7e9faccb80 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:33.940344 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-46b5e7e2-f920-40f3-9c7d-942b07a7e42f req-6dec5b5c-698d-4d56-bf64-0f7e9faccb80 service nova] Creating event network-changed:30c99a41-70c0-4d1e-8ee8-f223aac7dcb2 for instance d7ef4046-055e-46dc-b2ed-e43baa37d454 on hv-cinder-82549 Jun 02 09:29:33.945798 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-46b5e7e2-f920-40f3-9c7d-942b07a7e42f req-6dec5b5c-698d-4d56-bf64-0f7e9faccb80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097688 Jun 02 09:29:33.946338 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 556/1132] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:29:34.172903 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-229874ed-348a-4bb5-b929-7d16bd61d360 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 204 len: 0 microversion: 2.1 time: 0.327890 Jun 02 09:29:34.173721 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 577/1133] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:29:33 2022] DELETE /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:29:34.182385 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:34.183100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:34.190272 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:34.190710 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:34.191524 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:34.192100 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:34.342254 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:34.349859 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-cbdd0e72-e61a-4d36-a5c9-b08436535fef tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1578 microversion: 2.1 time: 0.171732 Jun 02 09:29:34.350431 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 557/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:34 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:35.369239 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:35.369870 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:35.376418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:35.376858 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:35.377618 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:35.378046 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:35.511432 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:35.519810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-ae0312ce-564c-4f28-b835-b418b5954567 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1578 microversion: 2.1 time: 0.154830 Jun 02 09:29:35.520371 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 578/1135] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:35 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:36.537310 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:36.537921 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:36.544305 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:36.544757 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:36.545522 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:36.545957 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:36.710534 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:36.718294 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-594f2049-3bf6-45b7-bd34-e438a5248284 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1459 microversion: 2.1 time: 0.184903 Jun 02 09:29:36.719006 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 558/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:36 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1459 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:36.814871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-ac68f929-8d75-4802-845c-f15fff4e9a55 req-374cc9bd-4df1-4ea2-bee9-1496819921bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ef4046-055e-46dc-b2ed-e43baa37d454", "name": "network-vif-deleted", "tag": "30c99a41-70c0-4d1e-8ee8-f223aac7dcb2"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:29:36.823498 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-ac68f929-8d75-4802-845c-f15fff4e9a55 req-374cc9bd-4df1-4ea2-bee9-1496819921bd service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:36.823871 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-ac68f929-8d75-4802-845c-f15fff4e9a55 req-374cc9bd-4df1-4ea2-bee9-1496819921bd service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:36.834955 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-ac68f929-8d75-4802-845c-f15fff4e9a55 req-374cc9bd-4df1-4ea2-bee9-1496819921bd service nova] Creating event network-vif-deleted:30c99a41-70c0-4d1e-8ee8-f223aac7dcb2 for instance d7ef4046-055e-46dc-b2ed-e43baa37d454 on hv-cinder-82549 Jun 02 09:29:36.839747 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-ac68f929-8d75-4802-845c-f15fff4e9a55 req-374cc9bd-4df1-4ea2-bee9-1496819921bd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028504 Jun 02 09:29:36.840321 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 579/1137] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:29:37.736440 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:37.737072 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:37.743533 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:37.743989 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:37.744779 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:37.745213 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:37.774602 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:37.775043 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:37.775545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lazy-loading 'fault' on Instance uuid d7ef4046-055e-46dc-b2ed-e43baa37d454 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:29:37.818668 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:37.826182 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-0e955f55-b48f-49c4-8604-5d0ec8bc52bb tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 200 len: 1231 microversion: 2.1 time: 0.094268 Jun 02 09:29:37.826731 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 559/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:37 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:38.843888 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:38.845172 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: d7ef4046-055e-46dc-b2ed-e43baa37d454] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:38.851414 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:38.851864 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:38.852635 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:38.853077 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:38.865843 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] HTTP exception thrown: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Request method failure captured: Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 HTTP/1.1 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimIFfMyl2nRl4D58ds6OENaO1QYAOxSS-XcosqbASwbjhUx3QXf5yNfhjxhy_0J6NZj7XTSVb8juWGuETC-mnzn97P4TdyiXpB0ZqP0nxCoiCCMx_I_4bfdgP2_fYaUCfZA8vPD8SoCyiylIK72XmpLvjOa5b5lb_kVOeG25NH6Wvc5c Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:29:38.867469 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9808f004162146c089568a0261f09d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9808f004162146c089568a0261f09d59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 97d63985256745499be671657584f271 Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. Jun 02 09:29:38.869255 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': 'd7ef4046-055e-46dc-b2ed-e43baa37d454'} Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:29:38.870413 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. Jun 02 09:29:38.872238 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:38.873857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Returning 404 to user: Instance d7ef4046-055e-46dc-b2ed-e43baa37d454 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:29:38.873857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-6eafb098-4a66-4199-96dc-b9935427223a tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454" status: 404 len: 111 microversion: 2.1 time: 0.029620 Jun 02 09:29:38.873857 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 580/1139] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:38 2022] GET /compute/v2.1/servers/d7ef4046-055e-46dc-b2ed-e43baa37d454 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:29:42.162145 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:42.167415 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [req-1c0c4553-f637-40b7-9383-0ad760da42be req-97c5bc85-1dc1-4791-9cf8-95630b8afea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18bc5982-7352-43b0-a25a-6b5df1738456", "tag": "e44d01e4-dc51-4f6d-b52b-ff3d27e15212"}]} {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:29:42.171446 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:42.177706 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:42.178250 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:42.179101 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:42.179630 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:42.182714 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-1c0c4553-f637-40b7-9383-0ad760da42be req-97c5bc85-1dc1-4791-9cf8-95630b8afea0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:42.183267 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [req-1c0c4553-f637-40b7-9383-0ad760da42be req-97c5bc85-1dc1-4791-9cf8-95630b8afea0 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:42.195575 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.compute.server_external_events [req-1c0c4553-f637-40b7-9383-0ad760da42be req-97c5bc85-1dc1-4791-9cf8-95630b8afea0 service nova] Creating event network-changed:e44d01e4-dc51-4f6d-b52b-ff3d27e15212 for instance 18bc5982-7352-43b0-a25a-6b5df1738456 on hv-cinder-82549 Jun 02 09:29:42.200951 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [req-1c0c4553-f637-40b7-9383-0ad760da42be req-97c5bc85-1dc1-4791-9cf8-95630b8afea0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037035 Jun 02 09:29:42.201643 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 581/1140] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:29:42.207030 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Going to try to terminate instance {{(pid=118037) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 09:29:42.506445 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-1af76699-e9d6-413d-ba94-675a499f775f tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 204 len: 0 microversion: 2.1 time: 0.348370 Jun 02 09:29:42.507024 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 560/1141] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:29:42 2022] DELETE /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 09:29:42.515752 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:42.516716 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:42.523538 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:42.523979 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:42.524762 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:42.525372 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:42.655845 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:42.663693 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-0d514bdf-9ba0-41b0-b896-27cf064501c5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1578 microversion: 2.1 time: 0.152022 Jun 02 09:29:42.664282 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 582/1142] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:42 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:43.681364 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:43.682071 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:43.688573 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:43.689021 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:43.690271 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:43.690729 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:43.860124 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:43.867812 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-ff7b0e0f-ed92-4233-af7f-2fe6465b3c21 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1578 microversion: 2.1 time: 0.190628 Jun 02 09:29:43.868373 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 561/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:43 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:44.885810 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:44.886430 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:44.894694 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:44.895145 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:44.895948 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:44.896385 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:44.933079 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [req-ec5b72b0-29a3-46fa-986f-1f12acda7780 req-0510c780-4df1-481d-80eb-1cfdede95958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18bc5982-7352-43b0-a25a-6b5df1738456", "name": "network-vif-deleted", "tag": "e44d01e4-dc51-4f6d-b52b-ff3d27e15212"}]} {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 09:29:44.938171 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-ec5b72b0-29a3-46fa-986f-1f12acda7780 req-0510c780-4df1-481d-80eb-1cfdede95958 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:44.938612 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [req-ec5b72b0-29a3-46fa-986f-1f12acda7780 req-0510c780-4df1-481d-80eb-1cfdede95958 service nova] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:44.950003 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.compute.server_external_events [req-ec5b72b0-29a3-46fa-986f-1f12acda7780 req-0510c780-4df1-481d-80eb-1cfdede95958 service nova] Creating event network-vif-deleted:e44d01e4-dc51-4f6d-b52b-ff3d27e15212 for instance 18bc5982-7352-43b0-a25a-6b5df1738456 on hv-cinder-82549 Jun 02 09:29:44.955410 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [req-ec5b72b0-29a3-46fa-986f-1f12acda7780 req-0510c780-4df1-481d-80eb-1cfdede95958 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030514 Jun 02 09:29:44.955998 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 562/1144] 10.222.0.18 () {64 vars in 1317 bytes} [Thu Jun 2 09:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 09:29:44.967274 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.policy [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118038) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:44.975418 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-2fee1179-b5e6-4067-8917-a40778eaf629 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1392 microversion: 2.1 time: 0.093683 Jun 02 09:29:44.975973 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 583/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:44 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1392 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:45.993128 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:45.993832 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:46.000091 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:46.000545 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:46.001341 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:46.002277 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:46.034947 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:46.035629 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:46.036085 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.objects.instance [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lazy-loading 'fault' on Instance uuid 18bc5982-7352-43b0-a25a-6b5df1738456 {{(pid=118037) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 09:29:46.079449 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.policy [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d63985256745499be671657584f271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9808f004162146c089568a0261f09d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118037) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 09:29:46.087590 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-a68b4509-33fe-4cc3-bf9f-2b27be2d95ff tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 200 len: 1231 microversion: 2.1 time: 0.099127 Jun 02 09:29:46.088150 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 563/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:45 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 09:29:47.105916 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:47.106767 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 18bc5982-7352-43b0-a25a-6b5df1738456] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:47.113761 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.114286 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.115126 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.115587 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.129358 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] HTTP exception thrown: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Request method failure captured: Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 HTTP/1.1 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimIFfMyl2nRl4D58ds6OENaO1QYAOxSS-XcosqbASwbjhUx3QXf5yNfhjxhy_0J6NZj7XTSVb8juWGuETC-mnzn97P4TdyiXpB0ZqP0nxCoiCCMx_I_4bfdgP2_fYaUCfZA8vPD8SoCyiylIK72XmpLvjOa5b5lb_kVOeG25NH6Wvc5c Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:29:47.131270 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9808f004162146c089568a0261f09d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9808f004162146c089568a0261f09d59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 97d63985256745499be671657584f271 Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. Jun 02 09:29:47.132799 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '18bc5982-7352-43b0-a25a-6b5df1738456'} Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:29:47.133660 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. Jun 02 09:29:47.135093 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.136390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Returning 404 to user: Instance 18bc5982-7352-43b0-a25a-6b5df1738456 could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:29:47.136390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-5db90065-3534-45fa-867f-a0c88a305d17 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456" status: 404 len: 111 microversion: 2.1 time: 0.030597 Jun 02 09:29:47.136390 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 584/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:47 2022] GET /compute/v2.1/servers/18bc5982-7352-43b0-a25a-6b5df1738456 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:29:47.631962 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:47.632498 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.compute.api [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118037) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:47.638392 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.639636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.639636 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.640072 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG oslo_concurrency.lockutils [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.653863 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.wsgi [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] HTTP exception thrown: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Request method failure captured: Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: request: DELETE /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c HTTP/1.1 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept: application/json Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Accept-Encoding: identity Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Connection: close Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Length: 0 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Content-Type: application/json Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Host: 10.222.0.18 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Openstack-System-Scope: None Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: User-Agent: python-urllib3/1.26.9 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Auth-Token: gAAAAABimIFfMyl2nRl4D58ds6OENaO1QYAOxSS-XcosqbASwbjhUx3QXf5yNfhjxhy_0J6NZj7XTSVb8juWGuETC-mnzn97P4TdyiXpB0ZqP0nxCoiCCMx_I_4bfdgP2_fYaUCfZA8vPD8SoCyiylIK72XmpLvjOa5b5lb_kVOeG25NH6Wvc5c Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Id: None Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Domain-Name: None Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Identity-Status: Confirmed Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Is-Admin-Project: True Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Id: default Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Domain-Name: Default Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Project-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Role: member,reader Jun 02 09:29:47.655535 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Roles: member,reader Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9808f004162146c089568a0261f09d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9808f004162146c089568a0261f09d59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-Tenant-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Id: default Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Domain-Name: Default Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Id: 97d63985256745499be671657584f271 Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: X-User-Name: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: method: > Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: exception: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.657348 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: action_args: {'id': '3853824c-a320-4115-a9a6-76383642e26c'} Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:29:47.658246 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.659936 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.661530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Returning 404 to user: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. {{(pid=118037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:29:47.661530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-269c7c85-5570-45ae-95ad-9db4f15793ab tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 404 len: 111 microversion: 2.1 time: 0.030058 Jun 02 09:29:47.661530 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 564/1148] 10.222.0.18 () {58 vars in 1238 bytes} [Thu Jun 2 09:29:47 2022] DELETE /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:29:47.665420 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '>' {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:47.666025 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.compute.api [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] [instance: 3853824c-a320-4115-a9a6-76383642e26c] Fetching instance by UUID {{(pid=118038) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 09:29:47.672024 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.672467 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.673217 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 09:29:47.673644 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG oslo_concurrency.lockutils [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Lock "2313d202-a844-40de-8f2e-fd9d46062c17" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118038) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 09:29:47.686440 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.wsgi [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] HTTP exception thrown: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Request method failure captured: Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: request: GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c HTTP/1.1 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept: application/json Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Accept-Encoding: identity Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Connection: close Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Length: 0 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Content-Type: application/json Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Host: 10.222.0.18 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Openstack-System-Scope: None Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: User-Agent: python-urllib3/1.26.9 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Auth-Token: gAAAAABimIFfMyl2nRl4D58ds6OENaO1QYAOxSS-XcosqbASwbjhUx3QXf5yNfhjxhy_0J6NZj7XTSVb8juWGuETC-mnzn97P4TdyiXpB0ZqP0nxCoiCCMx_I_4bfdgP2_fYaUCfZA8vPD8SoCyiylIK72XmpLvjOa5b5lb_kVOeG25NH6Wvc5c Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Id: None Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Domain-Name: None Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Identity-Status: Confirmed Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Is-Admin-Project: True Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Id: default Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Domain-Name: Default Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Project-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Role: member,reader Jun 02 09:29:47.687953 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Roles: member,reader Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9808f004162146c089568a0261f09d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9808f004162146c089568a0261f09d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9808f004162146c089568a0261f09d59", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Id: 9808f004162146c089568a0261f09d59 Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-Tenant-Name: tempest-TestVolumeBootPattern-1123569860 Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Id: default Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Domain-Name: Default Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Id: 97d63985256745499be671657584f271 Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: X-User-Name: tempest-TestVolumeBootPattern-1123569860-project Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: method: > Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: exception: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.690524 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: action_args: {'id': '3853824c-a320-4115-a9a6-76383642e26c'} Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: {{(pid=118038) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 09:29:47.691665 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. Jun 02 09:29:47.693360 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: ERROR nova.api.openstack.wsgi Jun 02 09:29:47.694933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: DEBUG nova.api.openstack.wsgi [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Returning 404 to user: Instance 3853824c-a320-4115-a9a6-76383642e26c could not be found. {{(pid=118038) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 09:29:47.694933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO nova.api.openstack.requestlog [None req-d345189e-2be8-4c1a-a22c-6083a1c4f5d9 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c" status: 404 len: 111 microversion: 2.1 time: 0.027678 Jun 02 09:29:47.694933 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: [pid: 118038|app: 0|req: 585/1149] 10.222.0.18 () {58 vars in 1235 bytes} [Thu Jun 2 09:29:47 2022] GET /compute/v2.1/servers/3853824c-a320-4115-a9a6-76383642e26c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 09:29:49.148948 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: DEBUG nova.api.openstack.wsgi [None req-7e90105c-073d-403e-b255-9f82393d9ab5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] Calling method '.version_select at 0x7f9670d61310>' {{(pid=118037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 09:29:49.230607 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO nova.api.openstack.requestlog [None req-7e90105c-073d-403e-b255-9f82393d9ab5 tempest-TestVolumeBootPattern-1123569860 tempest-TestVolumeBootPattern-1123569860-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2000011494" status: 202 len: 0 microversion: 2.1 time: 0.085642 Jun 02 09:29:49.231201 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: [pid: 118037|app: 0|req: 565/1150] 10.222.0.18 () {58 vars in 1262 bytes} [Thu Jun 2 09:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2000011494 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 09:31:04.867773 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:31:04.868370 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:32:46.438388 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:32:46.439060 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:32:53.230077 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:32:53.230622 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Thu Jun 2 09:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:32:58.687586 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:32:58.688210 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Thu Jun 2 09:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:34:24.876504 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:34:24.877118 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:34:44.359428 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:34:44.359998 dv-cinder-825492-19-iscsi devstack@n-api.service[118038]: Thu Jun 2 09:34:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 09:34:50.416430 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 09:34:50.416937 dv-cinder-825492-19-iscsi devstack@n-api.service[118037]: Thu Jun 2 09:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!